I commend you for trying to be understanding and helpful. It sounds like he has other issues (familial problems from childhood) that maybe should be addressed by a therapist. If he's not in therapy I would recommend it - even if he thinks nothing is wrong, it doesn't hurt to talk to someone.

Big thing is that you need to take care of you and address your feelings around this issue.

Tranquility