Can you maybe contact him and ask if you can keep in contact? Of course, the relationship will be different, but maybe he can still be a part of your life?

I have had contact with an ex-T and an ex-counselor for 9 years. My mental health had hit rock bottom, and I was ashamed to tell them. I felt like I had taken their help for granted because I slipped back into my depression. Every time I wrote, I made sure to never say how bad off I really was. Finally, my life had gotten so bad, my family called the police on me. I decided it was time to be honest with them. They were extremely supportive and encouraging. They told me they were not upset with me, and to worry about taking care of myself. It was a huge relief.

So maybe something similar can happen for you. Try reaching out. You might just be surprised.