Should transgenders be allowed to use public washrooms of the gender they identify as?

Why is it that we never had this problem before? I would bet that most people have been in the restroom with a trans person before. They just didn't know because for some reason we have a stereotype that trans people are all guys in drag. That is called crossdressing... The only people in danger are the trans individuals. They are terrified of being assaulted, particularly in restrooms. The whole "guy wearing a dress" is bs. In the states (and Canada) that have allowed trans people to use whatever restrooms they want, they have NEVER had an issue. If we are so afraid of something, why are we allowing people who have been convicted of sexual assault into our bathrooms? This isn't about bathrooms any more than segregation was about bathrooms. This is about marginalizing part of society. Besides, will you have people at every bathroom checking people's genitals? Or will you just throw out women who look too masculine for your taste?