You ever notice that when you

stop eating certain things you feel better?

I'm pretty sure the same principle applies when you stop dealing with certain people.