You could try visualizing if you have not already done this.

Visualize yourself when there are families with young children all around you. How do you feel? How do you feel about him?

Visualize yourself in thirty or forty years: no adult children around, no grandchildren, no fond memories of caring for kids. How do you feel? How do you feel about him?

Visualize yourself traveling, which you love, but never seeing the sights through the eyes of a child, always alone with him. How do you feel? How do you feel about him?