I always get mistaken for being gay

It can be quite scary if it’s a group of men/boys as they can be quite aggressive sometimes. One boy was so horrid and threatening that he made me cry as he was saying he was going to hit me.
Maybe it’s how I look as I’m quite slim and dress in nice clothes (I work in a clothes shop so need to be dressed well.)
I’m also friends with more girls than boys so I tend to be with a group of girls if I’m out.