From what you have written this sounds like a very difficult position in your relationship.

May you and your husband move in the direction that serves both of your best interests well in the long run from this point forward.