The being totally cut off from people I care about until I accept help really really scares me. Probably enough that I would break if it were me.
You are doing the right thing in not giving him money and looking after his children. One day he will thank you for it.