Maybe you can send a note or card with your dad to give to your grandpa to let him known how you feel about him.

I see no reason why you should set yourself up for hurt by going.

I wish you well

Hugssss
J