Sounds to me that (IF you allow), this man will drag you down so low to the point that you won't even want to get back up despite the love for your child or for self.

I've been there, done that. I realized that the longer one postpones the inevitable, (leaving the abuse), the harder one only makes it on ones self and the child, as psychological abuse is one of the hardest things to overcome....IF ever completely successful.

You are not only obligated to your child but to your own self to remove you both from his never ending abuse. It will only escalate and he will become increasingly more abusive.
The first sign of him noticing that you seek improvement of self, he will undoubtedly attack that with all he has by removing that from you to maintain his sense of control over you. He is obviously threatened by your progress.
This man is weak, mean and selfish. And you and your child do NOT deserve that.

Please, don't ever view yourself at fault...for whatever the reason. This is a tactic he will embed into your thinking (among all the other strategies he applies to his behavior), so that you remain out of guilt, as well as all the other emotions he brainwashes you into believing.
You have done nothing wrong to deserve his abuse. The ONLY thing you are guilty for is loving this person.
I wish the best for you and your child. I can only hope that you do remove yourself from his psychological grasp and make better for you and your child.

I apologize for my bluntness, and realize that not ALL circumstances are such as mine was..but from what you've offered so far, the odds are great that yours IS quite similar.

Take good care.

Shangrala