No mind is completely clean of negative thoughts towards others. I know mine isn't. Like Fuzzy said, if you don't act on them then it's okay. You don't deserve punishment for something you don't have a lot of control over.