I Am Not Close With My Sibling

My brother and I don't see eye to eye on anything. He's the exact opposite of me. He likes partying, getting drunk and being the center of attention. I hate all three. And it's these that he uses against me the most. The reason why I won't drink alcohol is because I'm too "up tight", I don't like party's because I'm "boring and bland", I hate getting attention because I "hate people".
I'm just not a sociable person. And this is a hard subject for him to grasp. So much so that he goes out of his way to make me and my parents feel like crap because I don't like company. Saying that my parents "sheltered me too much" and that they "gave me too much free will".
He also seems to view me as a massive failure due to me choosing to study games development at college over web development. When he found out, in his exact words, he said to me "are you just trying to point out that you're a failure? Why don't you just quit college and do something better with your time?"
The last time. I spoke to him one on one, he said he honestly wished he had raised me himself so he didn't have to put up with who I am today. Part of this made me think he maybe cared about me, that he wants to see me succeed in something. Or maybe he's trying to cover for his own failings