You cannot please everybody. Just be with those who accepts you as you are. You are too conscious on yourself (and how you act with them) as that can be a factor why they're going away.

Be yourself rather than maintaining the illusion that you're something you are not.