Does being a serious person make it hard for you sometimes?

I don't understand most jokes and if I do understand them I don't see what makes the joke funny.
I don't catch on very quick to sarcasm unless it's pretty obvious that it's sarcasm.
I don't understand most sexual innuendos and that includes when it's used in flirting.
Does anyone else have this problem? I never saw it as a problem until I started noticing over time that I missed something important in a conversation or in something I read. Maybe it's just part of being on the spectrum. I wonder if it's more common in people that have RBF. People ask me what I'm angry about and I'm not angry, I was just thinking about something, but my face gives an angry unapproachable expression I'm told.