sometimes I hate that I care about people too much

I'm not a religious person nor do i follow a religion. I think they are all corrupt and have been used (still being used) as a tool to oppress people. However, I do pray for others. I'm walking down the street and I see someone in need. I have the strongest urge to give them a dollar or some food. Yesterday, I saw someone asking for some money. He claimed it was for "food." I went to a local subways restaurant and bought a sandwich for him. Dude started complaining that it had mayonnaise when I gave it to him. So he didn't want the sandwich. Even with that, I had the urge to pray that this person gets the helps he needs to get off the streets. It annoys me that I care for people that don't deserve shit.