I'm not sure if this is it, but I have the same problem and I think it's because I'm such a 'people pleaser' there isn't much substance for people to hold onto. But at the same time, I withhold giving opinions on things for fear I'll be unpopular, but I've been unpopular for all my life, so...

ETA I really hope you'll be able to change the way you're perceived, and get.respect and love.