I've found "special" to be extremely condescending no matter who it is directed towards. It's a word you use with children, and no matter what disability someone has they are still adults. Some require accommodations, some people with severe impairments need around the clock care, but that doesn't mean they're any less adult or human than the rest of the population.