Yes I think this happens. Some labels get more sympathy and others labels appear more threatening. It also happens with some in the general mentally ill community - narcissists, schizophrenia, anti social, BPD, psychopaths etc are assumed to leave victims behind them, so there's less empathy/sympathy for them. They're also viewed as more difficult and obstinate to treatment.