I feel this for sure. Honestly, I generally find this to be a result of them making you feel inferior because of self-esteem issues of their own... It's much harder when it's a loved one or someone you're kind of required to spend time with (family member, co-worker), but I found the best thing for me was to try and limit my time with them as much as I could and find a "quick-fix" that helps me to shake that vulnerability feeling, like other people or activities that restore me to my proper self.