I think it's a kind of emotional boundary issue where your empathy is so great that you take on distress that isn't yours. If you were designated as the "feelings person" in your family where you sensed the unhappiness that others would not address or acknowledge and became a conduit for that unhappiness you are likely a sitting duck for empathic distress.