These are people on the internet and people I know in real life. I don't think its so important who they are, I think its important what they do: launch personal attacks, make totally inappropriate remarks, judge. I was thinking about this, here's why they're so toxic and you're not: you know what you are, what you can do, how you think and are open about it. These people are in total denial about what they are doing.
You hit the nail on the head earlier when you alluded to emotional sensitivity. Yes, I'm a highly sensitive person. That is what they prey upon, but now that I know that, I can turn that around back on to them.