Holding on to your anger will stoke his ego because it allows him to continue to control how you feel. Forgiveness doesn't mean that what he did was okay or that you continue to allow him to hurt you. It just means that you don't want to let him poison you with anger anymore. You choose love so that you can have peace, then he can't get to you and can't get a reaction anymore so then he doesn't get anything out of it. You don't have to tell him if you forgive him either. All you need to do is stop letting anger fester in you. And he still needs to be held accountable, not because you are angry, but because he does wrong and it is a dangerous situation and you deserve not to have to put up with it anymore. Maybe even because holding him accountable now can give him a chance to learn if that is possible before it is too late and he does something he will regret forever.