There is absolutely nothing wrong with not wanting kids. Especially someone else's! Now you need to decide if you can put up with the issues involved or not. His kids should rightly come first with him, and he would not be a good man if they didn't.

You have a difficult choice to make.