I think that your child should continue to see his grandfather. I believe that not being able to know his grandfather and not having the ability to say goodbye will have a larger effect on him than this could ever have.