Is getting angry at people for their homophobia a moral imperitive?

I have been racially attacked( verbally). Some people don't see anything beyond color, sexual orientation, religion and their own political preference. I'd say it's better to know who they are so that you'd know who to stay away from them. The more dangerous ones are the ones who are not openly racist, homophobic but are extremists under cover. They are the biggest cut throats because they strike at unexpected times or are just rude about it and the they say, "it's a joke." when you confront them. Cowards like that are more annoying than the ones who are loud about their ignorance.