It's obvious that he's not dealing with the stress of the whole situation very well. Perhaps not doing things was his way of escaping having to face the reality of how serious your predicament was. Some people avoid when they feel overwhelmed. They say yes, but then they don't follow through. They work harder instead of coming home because it keeps them from having to see the far more difficult issue of relating to one's family members who, like them, are imperfect and in need of love, care and attention. Working/making money/hanging out with friends/clients is always easier than facing the ones closest to you, especially when they're hurting and you feel powerless to fix things (especially for a man).

When you're feeling a little bit better, I'd suggest you try to have a session together with your therapist (or another neutral one) where you can talk about each of your needs and how you can help each other to feel loved, respected, cared for. I don't think he was purposely being cruel and unthoughtful (but I don't know him), it just sounds like he's in denial about the extent of your depression and is escaping into his job, hoping the problems at home will go away, or at least he won't have to be around them. This is not good for you or him. And if you have kids, definitely not good for them. They need you both.

I hope you get to have a good talk together soon and in the mean time, I hope some of your meds and therapy will make you feel a little better.