You do understand that he will want more too right? He will want you to even have sex with some other guy while he watches, are you going to call him on that too?
He is using "you" to play a form of catfishing with other men. It's a "control" fantasy for him and he is doing it for the thrill which is more important to him than you and whatever consequences this may have on you.