I am very much like your husband.
I don't blame you for breaking up with him just as I don't blame my recent partner of 7 years. She had to leave me and I'm glad she found the strength to do it because our relationship - indeed our lives - became a living hell in continual debt after I lost my job. Not that we fought a lot but there was a lot of tension and sorrow and despair. My partner needed a lover, not a child. I am glad she found the strength and courage to break up with me because our relationship was hurting us both.
However we are still very good friends and we still care deeply for each other and go to the same church and have many mutual friends.
I don't know what your post-breakup relationship with your husband is like but I do wish well to you both and I hope you can still be kind to each other.