Could you just hold up your hand, like "stop"? Or perhaps the timeout sign (making a T with your hands--my H does this sometimes to pause conversation because he works as a referee for a youth sport).