Are you concerned that if you don't meet him late at night he will think you don't want to get to know him better ? There's no magic and there's no reason for you to meet this almost stranger that late, and when you have to sneak around to do it.

Your gut is knocking...listen to it.