Sometimes dear, you simply have to put the past behind you and realize he's not a good friend for you to have. It sounds as if he is abusive to you verbally, and no one should have to have a friend like that. Just tell him that you cannot talk to him anymore, he probably knows deep down what he is doing to you. just end things with him.