Of course you can live without him. You lived alone, without him, before you got together with him. Your survival or whole life does not depend on this man.

The fact is that you are not enough for him. He told you this explicitly.

Give yourself the chance to be loved as much as you love someone. Not just the scraps that they throw at you. This guy will only throw scraps at you.