Personally .... Both my son and Husband have Aspergers Syndrome, we all use the term 'Aspie' affectionately. To us it's just like shortening someones name. We are members of many many support groups both here and online and I have never heard anyone complain that they didn't like the term. We all use it as it's easier to say My Aspie ... rather than " My son with Aspergers syndrome " ..... that said, we only use it in company of others who know and understand, if I was meeting someone new for example I would say .. " My son has Aspergers Syndrome ".
If someone who didn't have ASD or a family member with ASD came up to me and told me they found the term offensive I would be interested to know why as they have no actual day to day dealing with the syndrome and therefore in my opinion have no right to judge someone who does.
I'm Impressed that you took the time to air your feelings and ask those who do deal with it