If he is "unsupportive and rude" he disqualifies himself as being a friend. There is little you say in your story that leads me to believe, he is helping you get to a more stable place.

Talk to your therapist about the situation. It sounds like an mentally and emotionally abusive environment. No one should have to go through that.