i would be annoyed that it's happening again and get out of the relationship.
he's either too untrusting which makes the relationship go nowhere or he's guilty about seeing someone else himself and so paranoid about it, he's accusing me of doing the same thing.