No, you don't drive off, you get the other person's license plate number and stay put and call the police. The only time you would part ways is if there is no damage to either vehicle and while something happened that is a mistake, no one suffered any damages.