Why do a lot of people dislike autistic/Aspergers people so much?

No matter how much we try to keep friends or act normal and try to do things “right”, we just get disliked or yelled at. I mean people tell us to start acting “normal” but when we try to, we get told to act like ourselves.
One of my coworkers dislike me because I’m apparently “slow” on picking up on things and I’m “special needs”. Like when I don’t “see” what they see, she gets upset or irritated. I do my best but I still get scolded at. She talks to the other coworkers but never talks to me.