Do you ever get annoyed at yourself for being sexually attracted to someone you don't want to be sexually attracted to?

You and your body often are having different perspectives. And since we all are having bodies pretty much have the same issues