You are not alone on this one. It's kinda funny cause I thought I was the only one who was dealing with this. I see now from being on this site that it is a common issue. I was always called a hermit or asked why I don't have any friends? My answer was "I don't know I'm just a loner". Not really knowing why I felt this way. Getting older has brought it more to my attention. It would be nice to have someone around but when I don't want them around would they still want to be my friend? It's like a double edge sword. An ongoing battle of good and evil.
For me finding a place like this I hope makes that question easier to answer. For you and everyone else out there don't give up your not alone.