Hello, mm, and welcome to Psych Central! Yes, it's emotional abuse. No one should call someone bad names and be mean. And threaten to leave you. And you are being physically abused on top of that!

Can you get away from him? You really need to. This marriage is not a good, healthy one at all, and I am concerned about your future. Frankly it would be better to be alone than with a guy like him, regardless of how nice he appears to everyone else. The physical abuse might keep escalating, to the point where you really get hurt.