Do these people know how you feel about the guy? if yes, and they continue to talk about him in front of you I would remove myself from the room.