Can sleeping with another woman be labeled “just sex”?

I’m trying to understand. I have a relationship with a man. He met another who danced with him and told him she has been fantasizing about having sex with him. So he agreed and then told me it’s just sex! I’m not accepting that. I asked him to choose.