People who practice this behavior do so in order to control you. He has gotten you to a point where you struggle with self esteem and stay home more right where he wants you to be so he can feel he has control over you. You are probably very dependent on him, something else he prefers you be because he can feel like he is the one who is in control.

People who continually decline when it comes to their sense of self worth begin to suffer from Stockholm's syndrome. You can read about that and see if you can relate to the symptoms described.

It would help you if you could find something to join outside of your relationship, be it taking a class in cooking or art or a reading group etc. where you can get exposure to others who are capable of supporting your effort to regain some self esteem. Seeing a therapist can also be helpful.