This boyfriend doesn't sound like one to keep to me. He was physically abusive and he is now emotionally and verbally abusive. He is controlling and he is going to continue to tell you who you can go out with, who can and cannot be your friend. You are not the one who needs to change. He needs to change his abusive ways but you can't do it for him.

I've been in an abusive relationship and understand how you can love the 'good' part of him but fear the 'bad' part. Unfortunately you can't have just the good.

Drop this guy and move on with your life. If you have self esteem issues work on that with a therapist. I don't see anything positive in staying with your mean boyfriend.