Is it really offensive to assume someones sexuality/gender?

I mean some guys get offended if you call them gay when they're not. But if you assume that a guy is a guy would it be offensive? I am just so confused because someone told me it is wrong to assume someone's sexuality/gender like the second one, a guy being a guy.