Does not sound like you have forgiven him. Forgiveness is not condoning or forgetting. But if you are harboring a residual of bitterness, it will manifest itself. If a reconciliation is going to work, you need to be brutally honest with yourself. Either you forgive him or you don't. For a stronger marriage to emerge, your husband needs to know you trust him.

Good luck.