This is not the kind of man who should be involved in your children's lives. What he may or may not do if you leave him is his choice and not your responsibility. But your life and your children's lives are. Be gentle with yourself and remove this man from your life and your children's. It won't be easy but it will be easier than trying to make it work. Hugs.