I would think long and hard about getting further into this relationship. Can you see yourself living with this for 30-40 years? He is being abusive when he is not being his good self. Are you willing to put up with this kind abuse for the rest of your life. He sees nothing wrong with his behaviour therefore sees no reason to change. Life would only be worse living with him. Been there done that.
Gayle