I have this issue too but yet I do not initiate contact, of course my few buds that do email or call in a blue moon realize I am an odd ball. But then I never see as an invite to a part or celebration as they want something from me....
I take it as they want to see me.... Idk though... But I can relate to you