Well, to me, I feel that if you feel that you meet the criteria to ASD, and also your doctor(s) do too, then you most likely have it, since doctors wouldn't diagnose you with autism unless you met the criteria. So what if other people say you don't? Many people don't think I do, or at least no one really brings it up. I do tell a few people, like friends or people who do need to know, and no one has ever doubted me before. People talk around me about other people who have autism as if they are dumb, but I'm sitting in the room with them, so it's quite awkward. These people don't know that i have autism. My family doesn't believe i have autism, but I have been professionally diagnosed with autism.
There are many co-morbids with autism, like OCD, AD/HD, and anxiety. Even schizotypal personality disorder seems to be quite common with ASD, though I do believe the actual criteria excludes this diagnosis if you have ASD, I don't really remember.
But I can't tell you if you have been mislabeled, but it seems to me that your doctors believe you have autism, so it's probably likely.