Are you specifically talking about real life contact? I don't ever feel comfortable around other people. But I do feel the need of getting a deeper connection with someone.
If they are people I know for a long time, I'm not afraid of telling them I'd rather be alone than going out to watch a movie or something. Branding myself as an outsider. It all comes down to accepting your condition yourself first. It sucks though when we are misunderstood for being arrogant or cold, when in reality we're just shy.
People who judge you negatively for being yourself aren't worth having around! You aren't doing yourself a favour if you still try to appeal to them. But I know how hard it is to find someone who appreciates and understand you just the way you are.
I get your fear of rejection, and it becomes even worse when you find someone you actually care about. Don't wanna be negative, but the reality is, that your vision of having fun doesn't align with that of the people who invite you.
You can force yourself to put on a facade and act in a more socially accepted way. But we all know the truth around here. There's no point in fooling yourself if you don't enjoy it.
Of course it's a huge disadvantage in work spaces and social environments. That's a really depressing thought, isn't it?
I'm happy for you to have a stable and intimate relationship!

It's often times harder for a partner to accept your condition than it is for yourself. You probably already know it, but the only way to solve this problem is to talk openly with him about your fears and feelings. If there's any person in the world you can trust, it should be him.
Sharing your interests online is the best! If only they wouldn't be pushing so much into real life

You know asking personal questions, exchanging photos, voice chat or even meeting irl.
Yes I think you only question yourself because of others. Would you be happy with yourself if it was only about yourself?