Do you struggle with telling people "No" or when you feel you might let someone down?

I do have a problem with that. I have learned to think of what the impact will be to myself if I say yes.