Yup, audios work like that.

Also, on Whatsapp you can actually delete messages on the other person's phone, which I find creepy, but at least it leaves a message that it was deleted.