Almost anything by AC/DC -- their lyrics are reprehensible, but they make good music to scream to!
"You Oughta Know" by Alanis Morrissette, although that one I save for the person who did to me whatever somebody did to her that made her write it.
"I Do" by Lisa Loeb is a good revenge song, although it's a little too poppy to be angry to.
I agree, great thread!