I don't think there is anything wrong with you. I'm the same way, but I'm still in high school. People have been known to make snide comments behind my back when I do speak my mind and blow all of their answers/opinions out of the water.

I just ignore them all, and concentrate on the few people I have allowed to be close to me.