I agree with many of the previous comments. He is being abusive. I know the psychology of abuse is complicated and that you may feel like you can't leave but you really need to find a way. Is this the environment that you want your children to grow up in?

I would start investigating what resources and support are available in your area for victims of abuse.