I don't think you're terrible either. Sometimes people have their own mental "stuff" - their interpretations aren't reliable. Like... if someone is color-blind, you can't trust them if they tell you to look for the gray sign, because they're not reliably able to correctly identify colors.
Some people can't reliably see other people, there's just too much getting in the way in their head. Even if they say or act like you're bad, it's not because you ARE. It's because they're not seeing clearly, due to their own issues.
*hugs*