Do you ever get annoyed at yourself for being sexually attracted to someone you don't want to be sexually attracted to?

Good point. I'm doing that too :)

i have limits.
1- they are married (I don't give them a second look)
2-they're my teacher or coach (I keep it professional)
3-they talk sexual about women (I don't entertain)

Sexual attraction doesn't give me the green light to go any further with them unless they fall under my guidelines

Good point again :)