I'm going through a similar situation like yours and I understand how you feel. Maybe you should sit and have a serious talk with your husband about the issue and try to reach an agreement.
If you don't take a measure right away you could end up like me: Without friends, without self-esteem, without goals.

Please don't let that happen to you...
I support you.
Hugs