Are you, as a non religious person, offended when people say they will 'Pray for you'?

Depends on the context and tone. Some people really mean well. Usually they say something like, "we will keep you in our prayers" because they want us to know they do think of us often.

Other people are being dicks.