I Think Honesty Is Very Important In A Friendship

I don't know how to deal with my best friend being so friendly with everyone. Specially with people that are bullies and have hurt others. He is aware of what they have done, but it doesn't seem to bother him. I've even heard him join in on their trash talking of people behind their backs. All of my other friends do everything they can to have as little interaction with them as possible, but my best friend just jokes around with them and enjoys talking to them. I dislike associating with such people and have become uncomfortable with my friend because of this. He knows how I feel, but just brushes me off. I've been tempted to drift away from him because of this. I just can't bare being around such people, and if my friend is going to be one of them, I'd rather not be part of it. I dislike the fact that he's one person with me and a different one with others. He's the type everyone seems to like and enjoy talking too. I'm quite the opposite, because I'm not one for meaningless conversations, gossip, small talk, and such things. Has anyone ever gone through something like this? What are your thoughts?