A phobia denotes an irrational fear

This means that terms like:

Transphobia
Homophobia
Islamophobia

Are not actual fears.

They are simply hate that has been learned through the behaviors and beliefs of others and not irrationally aquired.

So just say you hate a group of people. Tell someone they simply hate a group of people. It is more genuine and true than saying they have an irrational fear of something they do not have.