Are you, as a non religious person, offended when people say they will 'Pray for you'?

Not offended but I would tell them not to.
When I was in my dark days and seeing a psychologist he asked me if he could pray for me.
I said do it for yourself but don't do it for me.
He never prayed.