It does matter, gigantically. By being a great father, you've greatly increased their chances of being successful and happy, not just now but throughout life, and it will also influence how they treat their own families in the future. That is a gigantic accomplishment that should not be put down or ignored just because they are older.