Why do people sometimes feel more loyal to the people who hurt them than to the people who treat them well?

I have some weirdo trying to get me to go to his house. I sent him a picture of a morbidly obese woman. Do you think that will stop him from bugging me?
Why do people sometimes stay attached to relationships, habits, or identities that keep hurting them?