I get embarrassed when Spanish speakers speak a word I don’t know

I know conversational Spanish, but I’m far from fluent. I’m able to carry a conversation in Spanish, but then one will use more than a few words that I don’t know and I’ll hit a wall. 😣