Agree with the above. Get out, or get him out, if you can't do it for yourself, do it for the children. You should probably sit down with a lawyer, before doing anything, so that you know your options, and how to proceed in a way that is best for you and the children.
No child deserves to be hit. Period. Or belittled.