When they say these things to you, what happens? Do you apologize? Nod your head in agreement?

Learning to detach isn't easy. The inner peace that comes as a result of working towards that goal is worth it.