Maybe I fit in another category, but my avoidance isn't from fear but because I just don't have anything in common. I love to talk about psychology, science, politics, fantasy, and even religion. But anyone I meet just wants to talk chit-chat or complaints about their life.
I do all right with a group of people, but if one of them asks me out to lunch, I will avoid it like the plague because I don't want to be bored to death. And if I do go, I encourage the person to talk about themselves because it's obvious they don't want to talk on a deeper level, and I'm just trying to get through the time we're stuck with each other.
Arrogant, I know, and I do have compassion for people, but I'm tired of being a fake.