I think you're insecure because you depend on others opinions of you to shape your self-confidence.

You feel better when the person you like, thinks highly of you.
Feel worse if whomever doesn't like you as much.

(This is from my observance of you)

I wish I had a solution but I don't know. Sorry.