There are a lot of red flags to me in what you wrote that say he has no respect for you. It's not that he has kids that is the issue here, I think. It's that he is quite possibly an a$$hole.