He is wrong, and people who do things like him are abusers. I have similar relationships, now - no friends, no money, no self-esteem... I think I love him, but it's a dependency.
I wish you to pass through this smoothly and with minimal damage.