I think he would appreciate the gesture too. You can say that you don't know if it's appropriate and will understand if he doesn't actually attend, but that you wanted him to know that he's welcome and played a big part in it actually happening. And congratulations to you!