Your husband reminds me of mine...except my problem is fear of robbery by HIM.
If I were my old self, I'd say tell the guy to either honor your feelings as you honor his, or take the consequences. Unfortunately, I'm trapped right now, and can't make any moves that might endanger me further.
I guess it all depends on how much you trust your relationship with your husband, and how stable it is:
Will he leave you if you continue to demand change?
How would it affect your life if he did?
How much are you willing to risk? ("Never bet more than you can afford to lose.")
Maybe your course of action should depend on your answers to questions like these, that you ask yourself.
But what do I know. If you look at my post, you'll know I'm not in a position to be giving ANYONE advice.
Ms. Terious