I don't think you are being selfish. It sounds like you are going through a really stressful time. Your boyfriend needs to be pulling his own weight and taking care of his own kids.

Stop buying groceries and they'll probably beg to go back to their mother's house