I admit it gets hard for me to leave certain friendships. There are times I reach out to people, and I won't get a response for a very long time, although some of my friendships have just faded with added responsibilities on both ends.
As far as Bipolar playing a role, sometimes I have a tendency to attract the wrong friends into my life during manias where I am more impulsive. People will observe me spending a lot of money, drinking, or having big plans and latch on to that, or other qualities/impulsive behaviors I have during mania. I'm not sure if you've observed similar patterns in sometimes having people in your life who aren't particularly genuine, but you met them during a vulnerable period of time?
No matter what the reason is, that is hard to deal with, and I'm sorry you're going through that.