If he is abusive, and you say yourself that he is, get out and get on with your life. I was also had a difficult childhood, saw my mom being abused by my alcoholic father, etc. but I have overcome this and you can too. My wife and I occasionally have an argument but have never let this get physical at any point. If that were to happen, I would have no alternative but to leave. Good luck.