Never listen to an alcoholic drunk. He is responsible for his problems not you. Talk to a lawyer ASAP for your own mental health. He is talking through his alcoholism which is basically talking to a narcissist that wants to blame his problems on you/others

You did the right thing leaving him, thank god you have no children. Some alcoholics get very mean and abusive when they drink. You made the right choice in walking away.