is it normal for guys to jerk off to their girls voice?

I started dating a guy like a week ago but we’ve known each other for few years before dating, we discussed everything and decided not to be sexually intimate before marriage because both of us are date to marry people and do not believe in sex before marriage according to our religious beliefs
Couple of days ago we were on a call and I noticed that he’s jerking off to my voice, I hung up right away and he called like an hour after and I confronted him about it and told him that I’ve felt extremely uncomfortable about it. He kept apologizing, expressing regret and last night he showed up at my house crying for forgiveness
Idk if I’m making a big deal out of it or what should I do not actually know what to do
Because I’ve never been through something similar before