First this is turning into abuse. You're being isolated and controlled. Withholding finances, making you feel demeaned, yelling ... those are all emotional abuse.

That all needs to stop immediately and you guys need to go to counseling. Probably together and separately. If he doesn't stop with the abuse though, you're going to have to consider what you'll need to do to protect yourself and kids.