My boyfriend and I have been together for three months and we were happy but....

Things are starting to go downhill. He found out that I have autism. Well Asperger’s syndrome and it’s kind of straining our relationship. He starts calling me and texting me A lot less like whenever I try to call him he doesn’t answer. Of course I give him space for a couple of days but then after that I’ll call him again he still doesn’t answer. I really don’t understand and my friends tell me I should dump him because there’s something not right about him. My best friend HATES him and try to convince me to break up with him but I didn’t wanna listen to her so I told her to mind her own business. She keeps telling me that he treat me like crap he flirts with the girls right in front of me and he doesn’t even contact me. My other friends don’t like them either you’re my family isn’t fond of him. I don’t know how he found out that I am autistic but I have a feeling he’s gonna break up with me. I don’t understand why my family and friends don’t like them that much. I’ve been so happy in the relationship and I just don’t understand. I just turned 27 and I’m three years away from turning 30 and I don’t wanna be single by then.