I think the people banging things around are angry. The lack of control makes me insecure as to what they might decide to do next, so I anticipate further escalation of violence from them.

It is more the distress from their anger and wanting to be away from the tension more than the actual sound for me. I am an introvert by nature anyway so even nice quiet non-angry people can be draining and mean loud angry people are very triggering.

PS I love your MM sig photo... awesome.