Since my boyfriend is calling other women beautiful in front of me I should dump him, right?

No, not just for that. Acknowledging someone else's beauty in no way detracts from his appreciation for your beauty. It isn't a zero-sum game.

That said, he better be doing the dishes and giving you footrubs on a regular basis.