Yes, that would be a painful exchange for me too, Ruby. I've had many of them. So many people are insensitive like that.
I like Winter's suggestion of what to say. If said somewhat humorously as Winter suggests, that would get your point across without too much heavy duty emotion.