I have a similar issue. Most people I meet are not really people I can connect with BUT there is an endless line of people clearly trying to hangout or get to know me. Part of me thinks maybe I shun them away because I'm scared of being judged as boring or strange since I feel very much as an outsider most of the time.

I don't know how much you can relate to this but most other people seem so unrelatable and distant. Still I try to be courteous about it, maybe being frank about it and telling them you are very much an indoors person would get them to take some distance. At that point you are setting boundaries without making it a personal issue.