Telling someone they are too insensitive is abuse. I heard the same words once.

I agree that people saying this have a lack of empathy.