I think a lot of what one calls others is what you were raised with or picked up in one's social groups, liked, etc. I don't take being called any particular thing personally, to me it's more about the person using the name rather than me.

I agree though, if you're uncomfortable with someone, don't spend time with them or feel guilty. It's sometimes hard to believe :-) but other people enjoy/want to get to know us even though we aren't interested in them, just like we're sometimes interested in people who aren't interested in us. I think sometimes we're so use to "putting up with" friends and relatives from our childhoods that we didn't have much say about being around that we still feel "stuck" when we get to adulthood and can choose who our friends and people we want to be with are.