Making an appt. with a psychologist or a couples therapist wouldn't be a bad idea, especially if he is willing to go too.
In fact, you both should consider doing this before this problem gets out of hand and spoils your relationship, life is too short to keep dwelling on the past, things that you can't change what happened. Couples counselling will help teach you to put it behind you and move on but you both have to work along with the counseler too. I wish you much luck and love, let us know how you make out.
Take care,
"darkeyes"