I went through this too; I'm not a parent with kids and I know our family situations aren't the same so I can only say this from my perspective. I would say do what you want to do while showing them that your family is still important to you.