Does it bother you when ppl talk badly about you?

I think ppl at my work sometimes speak badly about me at work even if I am nice. I am big on character but this has been bothering me. Like I am nice and polite and dont gossip so what else can I do?