I generally dislike both total silence and total noise at the same time, so I understand the whole paradox thing.

For me, a lot of noises are "triggers" for me... such as sirens (police, fire, ambulance), firecrackers (the ones that sound like gunshots), random people just yelling to each other on the street (day or night), and the sound of cars either driving down my block or pulling up near my home. There are many more, but I don't think I need to go further with the examples.

The point is you are not alone and many of us suffer from "noise anxiety" for various reasons.