You were right to leave him. A man with a controlling personality is not a suitable mate, as they will cause nothing but emotional distress. I would suggest you not return to the relationship, but it would appear you've already done that.
Judging by your post, this man is manipulative, domineering, and rude. I think you are well aware that, even if your relationship is fine as of now, his old behavior will resurface and perhaps worsen.