I think any woman would have been caught off guard. To be approached wordlessly at night, that's not a typical interaction, it's definitely often typical of something more sinister.

I would have frozen, too.

Glad everything was okay in the end. You weren't at fault, your reaction wasn't wrong. He was the strange one in not saying something!