Hi Cupcake and welcome to PC,

You need to stop seeing this guy, I feel sorry for his wife and kids.
It will be hard but tell him "You're walking away"

Sorry I can't more helpful.