Moving back to your parents' home is not a good solution . . . if you have a better one. They are giving you an option to consider, which is rather nice of them.

You don't want to keep the kids from "their dad" (who doesn't even support them) because why?

I agree, nobody should "discipline" your kids, but you. You work a lot, so do you need this man around mainly as a babysitter?