Do people call you honey when they hear your voice?

I have a light voice that sounds younger than what I am. I get a lot of "ok honey", after someone talks with me on the phone..I'm typically fine with it, but they probably think I'm about 25 lol.
They occasionally do it in person too, I get people a decade younger than me calling me Honey lol.