You are not a bad person at all. You can send your condolences to grieving family a different way without putting yourself through the misery of going back to that town & building. No reason to feel guilty for that.

Hugs to you.