Maybe he's depressed about it too and is coping by spending time alone. This is usually how I behave when depressed.

On the other hand he should understand that this affects you and provide support.

If you're both depressed then I suppose you should be supporting him as well.