It's not wrong for you to leave. He has a responsibilty to help support his children and he is an unfit father. If you stay with him, your children will see his example and one of them may grow up to treat you the same way he does. I hope you make the call.....