My first thought is, Have you been abandoned in the past? Especially when you were a child?
My next thought is, Is this kind of fear something that you struggle with throughout your life, or does your abandonment fear apply specifically to a certain group of friends?