Is this common at all?

I work with kids who have autism and yes it's definitely commonl! I have some who don't really understand personal space, some that can't tell when a person is not interested in conversation, and some who seem "serious" but they are a lot younger than you. Also, ABAs are tremendous with helping with that (: but that is completely normal with people in the spectrum.

I used to be referred to is rude and some of our behaviors can be perceived as such but we really don't mean it.

Yes. You're not 1 bit alone on this. I've highly functioning Asperger's Syndrome (I feel really lucky to have it) & rudeness isn't too big a problem for me anymore. But I'm awful at eye contact & hiding my emotions, I can be a bit retarded, & more. The positives outweigh the negatives though.
I'd like to know what makes people think you act rude. Do you mind replying me that?

Let's leave autism out of it for a moment ... Everyone is different and bought up differently, people have different expectations of how others should behave ... So even without the autism, it's possible to be considered rude with out meaning to be :)

No you're not my husband us the same, it's like the feelings are there on the inside but he can't express them, it's almost like being emotionally disconnected..

From one to another, no, not alone in that at all. It's taken me a long time to get social cues down to where I'm not constantly coming across as rude.

I have high functioning autism too. I experience this quite alot. I will just be talking to someone, asking a question or just trying to make conversation then i can see i have upset them. I will ask why but they take it as I'm asking them why because i feel like i did nothing wrong, no i just don't understand what i said wrong. Then i will say sorry and i get the annoyed voice, "It's okay Alyx". They think i say sorry to make myself feel better, i say sorry because I don't know what else to do!

Seems to be a common trait, they don't understand you think and respond a bit differently than the majority.

I do too

I have a friend who has Asperger's. Sounds similar.