I think it may be a boundary issue, in that if we have firm boundaries it can help us be less affected by others emotions, but still able to connect and respond with empathy.

Here is a link about emotional shielding you might find interesting:

5 Ways for Empaths to Shield from Negativity | Spirit Science and Metaphysics