Wow. It sounds like he's a really bad match for you. I'm amazed he won't let you vent to his friends just because they might think of him differently. If that's the case you should definitely vent to them D:< Jeez. Anyways, either way that doesn't sound like a healthy relationship. He sounds really possessive and potentially emotionally abusive. Especially if your self-esteem has really taken a beating. Sorry but since he's so quick to put the blame on you all the time, I don't think you should be in that relationship.
My sister was in a relationship like that and I saw her turn into a shadow of herself.

it was terrible to watch.
Best of luck and feel free to PM me!