Your peace of mind is at stake here. You know what you can handle, and this guy's reversion is taking you to a place you don't want to go.

Stop talking to him. Give him an ultimatum if need be. You aren't his therapist.