I know what you mean.
I always think that people wont accept me for who I am, just because a lot of people dont. That at times makes it hard to make new friends.