I am very frequently told I look as though I am sad or bored, even if I am perfectly content. Once, I was talking with my cousin about a new job. "I'm so excited I can't stop smiling." Said I. She looked rather confused. "You're not smiling." She replied. Ho-hum. It is a bit annoying having to over-exaggerate my facial expressions so I don't look utterly disinterested, but methinks resting b**ch-face would be more bothersome. People would think you a mean person without even taking the opportunity to speak with you.
I'm not really one to find offensive remarks where they are not intended. Usually, I am at the other end of this sort of thing. I'll say something and the other person will get annoyed or upset. I've no idea why. Perhaps you wouldn't mind articulating exactly what it is that causes your initial frustration in situations such as these?

You're overly-emotional and I'm callous, but at least we're self-aware, eh?