Thanks! I pretty much did that.

I let him talk for a while, and I only said, well, there's nothing more that I can say that I haven't already said. He gave me a hug goodbye and said that he is willing to give me a positive reference in the future. So that's good at least. He also said take it as a compliment that he is mad and disappointed I am leaving.