I have had similar things while alone in a quiet place during extreme anxiety. I just thought of it as a curiosity and let it go. It only happened a few times. And yes, it was just like one side of a normal convo except it had no connection to me. Never posed a problem and never became a frequent occurrence.
It doesn't sound like you're going crazy