I think it's good that his honest.
It is hard parenting, let alone parenting when one has issues. But yes, it is hard on our partners too. But if we don't have a little time away, both parents, then it can make things even more frustrating.
Can you not organise things to do with your daughter the time hubbies away?
I had 3 kids, twins too, is not easy, but we have to blindly keep trudging. No matter what we're going through.
Good luck.