Where I live its a small town and in the south and everybody is sir or ma'am or miss

It kind of makes me stand out if I am talking to people from somewhere else so on here I try and remind myself not to do it. Does anybody else come from a place like this and feel funny talking to people from someplace else or am I just being weird?