Does it matter if it's wrong or not? Sounds like you have the feeling, either way. If anything, thinking you shouldn't have it is going to make it that much harder to let go of it and move on.

As for how you came to react that way in the first place -- I'd guess those people posed some sort of threat to you that you weren't up to handling more gracefully. In that case, identifying the threat would be the first step toward letting go of the feeling.