What he said about leaving his other love because she kept thinking he was cheating is scary to me. I don't know that he is, but remember that a man who will cheat on one woman will cheat on another.
I agree. See if the two of you will go into counseling. If not, then go yourself.