Trust is a huge factor in a happy relationship.

This definitely doesn't sound right. He is very controlling. I would definitely leave him if I were you. I suggest you talk to him about it.. What makes me nervous is that since he is already emotionally abusive, could that turn to physical if he got angry enough? I don't know him, obviously.. But I think you should definitely be careful while talking to him.