Yeah, I get it too. Especially the "but he's your father" or better the guilt trip "He must miss you."

I've taken to responding with "He starts acting like a father and I will treat him as one."

People need to understand that it takes more than just creating a child to be a parent.