My advice is not to stay with him out of obligation, if you have issues with his children I'd let him know so he can find someone more suited to him.
You sound as though you feel you HAVE to stay with him.
A guy doesn't want to feel as though you'd rather be elsewhere.
That's asking for trouble in the relationship from this point onward.