I agree, you don’t have to forgive him. As the wronged party, you’re entitled to respond to his apology however you see fit. I am sorry that it happened in the first place and, no matter how much what he did might have been bothering him, it does look like he was deliberately lessening the chance of backlash towards him by limiting your options for responses. It’s not fair on you.