I think one could say something if the people were trying to joke with you about it. But if they were joking amongst themselves, I do not see it as something that can or should be controlled. There will always be jokes that some are sensitive to, and although there may be every reason to be sensitive, that doesn't mean that everyone else has to change or be hyperconscious about possible sensitivities that someone might have.