I assume from your post that you are both very much interested in having children.

If this is the case, must they be your own biological children? Or perhaps there is an interest in adoption?

If there isn't a strong interest in children or you are willing to adopt, his mother's point is moot.

Have the three of you ever sat down and had a conversation about all of this?