I think you should have someone else there when you confront him, i've been in situations where i was alone with ex's and they tried to hurt me pshycially when i tried to break up with them, one of them was going to kill himself by walking in front of traffic. The same person got pshysical with me several times when i was trying to get away from him, but i would have to tell him i loved hm so he wouldn't do anything to me or himself, which i didn't mean, but was scarred for my safety.