I'm so sorry for your losses. I do not know how I would handle that much loss, but I guess we are stronger than we think sometimes. He is willing to go to counseling with you? I would expect him to accept responsibility for his part in this before I would consider going forward with him. For him to blame you for his infidelty is just wrong. Wishing you the best but I'm not sure he is it.
Gayle