It sounds that you are better off without him. Controlling who you see and what you do is wrong. I have also noticed (at least in my experiences) that controlling people tend to be abusive. I do agree that his throwing you out and firing you was not a good way to go about things.