I find it a little rich that he says you are "controlling" him because you don't want your boyfriend spending endless time consorting with multiple other women, including time naked in bed with them and, evidently, having sex with them. I would rather say that he is try to control you by insisting that you understand and accept what the vast majority of romantic partners, women or men, would not understand and would not accept.

What do you like about him?