Something is going on. In his heart, he has never really committed to an exclusive relationship with you.

The problem is not with the women, but with his making himself available to interact with them.