I've had the experience fairly recently that I needed to leave some friendships because they didn't nurture and support me. People are often hurt and angry by what they perceive as rejection and I didn't find any substitute to just stopping the contact. And I think your "friend" telling you what other people saying is also a messed up dynamic. I have asked other people to not tell me these kinds of thing and stopped seeing them if they didn't.