Sorry you are struggling MagicMan. I never thought of 'goofy' as a pejorative. I often describe myself that way...when I'm in a goofy mood or a goofy sense of humor etc. My other 1/2 uses it too in a favorable way. I wonder if you could subvert some of these words in order to diminish their power. Sometimes female friends use certain words (which can be very offensive words used against women) to playfully relate to each other....completely turning the words upside down. There's also a word that people of color have started to use with each other to subvert it....they have taken ownership of the word...to lessen its power as a weapon against them. I read a book about it. Very clever strategy when you think about it.
I wonder what would happen if someone called you a nerd or a dork and you looked them right in the eye and immediately and proudly replied: "Yes I am! Damn straight!" with a big smile on your face. Might take the wind out of their sails if you see what I mean.
Peace and hope to you

You deserve happiness.