I’d say couples counseling also.

He will either fully forgive you or not, if he cant then he will likely think about it and you will feel it’s always hanging over you.

Love letters are a beautiful thing, I like that idea, but those can’t be forced.

Go easy on yourself