What does the gay community think of straight people?

I could be wrong but it seems to me that the LGBT community is not as marginally larger than the ''straight'' community, unless the LGBT people are much more private.