@Confused1991, it sounds as though your husband might be trying to isolate you. I've heard that this is a sign of controlling behavior, possibly leading to abusive. He certainly seems insecure.

I like what @Tart Cherry Jam wrote about the importance of work. I used to joke that I work only for the health insurance and that the money was the benefit. But with my wife's chronic health challenges, health insurance is vital to us. And the ability to retire with Social Security is a nice perk. (I'm in my early 60s).