It's stupid but i get anxiety with public restrooms because im afraid i won't pass enough to use the womens room or I'll get thrown out of the buildin

Might be best to just tread carefully all you can with that. Lest you encounter individuals like the couple of class acts on this post going out of their way just to talk shit about transgenders. Please don't let them get you down. They're only revealing far more about themselves than they are you.