Hi and welcome, SKB!
Yes, I felt this for more than a year with my therapist. I talked to him about it repeatedly, and it (mostly) went away, very gradually, when I saw that he did not in fact abandon me. The fear comes back now and again, but it does get a little easier. I hope that helps, and I recommend talking to your T about this. You are not alone in feeling like this.