Maybe 'fight back' is the wrong word. Certainly talk about it, but he would have no motivation to stop his antics and it can't go on so efforts must be made to break the chain.

I have realized that I forgot how scarey it is to confront a bully, especially when your security and lifestyle of your children are at stake, but those things are already at stake. Take little steps by first talking to him, then stopping him in mid sentence to tell him to stop, and even walk away. It is scarey to risk starting an argument because at first you are not likely to succeed, but from my experience, anger is better than depression. With each effort, you get stronger and it is very possible that you two could happily married to the end.

If I sound harsh, I apologize.