I don't think he has gone anywhere.

Look at his responce... it wasn't hurtful to you as he's left the door open.
Of course this is what we do and that is to feel pressured and overwhelmed by avoidance so we push people away to simplify.

I think when you're up to it contact him. Personally i wouldn't tell him about your Avoidance, but let him know that you struggle from anxiety from time to time.

Welcome.