My gender and sexuality

So firstly, about my gender identity: I'm gender non-conforming, meaning while I feel like a cis man I don't always fulfill society's expectations of what a man should be/act like, and it's always been that way for me. I used to often be called a girl by other boys so my whole life I've always gotten along better with girls and only in recent years I've made a considerable number of male friends.
Now, my sexuality is more complicated. A lot more, actually. If I HAD to label it, as of now I'd say I'm homoflexible and panromantic, meaning I'm almost exclusively sexually attracted to men, but MIGHT be able to have romantic relationships with non-men too. I rarely experience sexual attraction to women and other non-men, and when I do it's really just a fantasy.
I really don't see myself being intimate irl with anyone but men which is why I tend to think of myself as just gay, but before I confuse people with a more complicated, yet more accurate label like homoflexible panromantic I'd rather just say I'm queer.