When I do, I don't take it to mean much.

-- I've personally found judging pretty counterproductive. That tends to shape my opinion of those who do it a lot.

-- Those who know me well enough to judge me, seem to have very few complaints about me and the complaints they do have, I tend not to find very upsetting. A friend recently complained that when we go camping, I slip off to bed early instead of joining them in evening activities like singing around the campfire. That's right, I do!

-- Those who've judged me the most harshly in the past, have demonstrated pretty convincingly that they didn't know me at all well.

-- If a whole bunch of people who knew me only from a distance were to get together and start telling each other how awful they thought I was, it's hard for me to picture what harm that would do me.
Speaking only for myself here, I'm more concerned that you'll withdraw from a nice gathering where you are wanted. (Pretty avatar, by the way.)