I think it could be a combination of things.

I feel very anxious ever going inside the hospital where my mom passed. It’s a major chain with several different facilities spread out, she was at a central campus. It’s nearly impossible to avoid to ever go there as it’s such a major facility but it always feels so depressing.

The way you felt seems somehow familiar to me. It could be grief or anxiety or loneliness. Human emotions hard to understand.