I try to call people out on those things immediately. 'Excuse me?' is always good if you don't have time to come up with anything else.