Thank you everyone for your words it is nice to read that I'm not the only one who fears this stuff. I'm going to be seeing a therapist again soon regarding anxiety and self-esteem issues so I'll be sure to bring these things up as well.
I have had people tell me that my quirkiness is what they love about me and that does make me feel good inside to know that who I truly am and who I was meant to be is loved by some. It's just when I get those weird glances or silences where I start to doubt myself. I'm hoping one day I will be so confident in myself that I won't even notice any negative responses