You are right, it seems he is trying and it is good of you not to want to let him go, and stay by him. It just seems you, at the moment, are having a rough tide...

How about seeing someone (professional/couples therapy maybe) either him or the both of you? Do you think that might be an option?