Do you think it's important to retain a sense of humour, even when you know there are people who will misunderstand?

Yes.
Because no matter what you do or what you say, there is always going to be someone or the other offended by it. To please everyone you have to cease existing.
So why not please yourself? As long as you know you're not offensive, you have to let people manage their own sensitivities.