I would leave him, or at least take a break from him. I would tell him that I can bring my own self down without your help. He sounds controlling and abusive.