It sounds like you are experiencing a kind of sensory overload, which as a set of 'symptoms' can have many different causes. Regardless of the cause of it, there are different things you can do to support yourself with it. It sounds like you are doing some of them intuitively - avoiding overly stimulating environments etc.
Look up terms like 'sensory integration'; Dabrowski's overexcitabilities, or 'sensory hypersensitivity'.
I (we) have sensory issues, and are particularly sensitive to stimuli when triggered (isn't everyone?). I often avoid social situations or make sure that I have an 'out' for when things get too much. I don't beat myself up about it. It's what I need, I just can't cope with more, so I make sure I take care of myself but not pushing myself beyond my limits. (that never works out well!)