I don't think you have to go, at all. And I don't think you should go for the reasons you listed above. It would be unhealthy.

If anyone asks and you feel you want to respond, tell them health reasons precluded you from attending. And leave it at that. You could send flowers if you want but I don't think you have any obligation to do so. Send them if it gives you peace of mind.