hmm... let's put it at another point of view. Treat it as if he has an ex gf whom he has sex with. I believe you probably had an ex bf and have sex with him b4.

And I think you are lucky that he told you about it and stop having sex with those "ex gf"