Are you straight but fantasize about crossdressers?

I know some people say you may not actually be straight if you think about having have sex with a feminine guy but I’m not so sure. I’ve been around straight guys who I can tell are interested in me for whatever reason. Especially if I’m dressed feminine. And some can be very aggressive about their fascination. Maybe it’s an appealing taboo or they imagine I’m actually a woman. Whatever I don’t think sleeping with them suddenly changes their sexual orientation or at least it doesn’t in my mind