This impulsiveness may cost you your life. Maybe he's harmless but he doesn't sound well put together or stable to me. You play with him, you may end up pissing him off and regretting that, too.

At this point, sex is a driven factor for the both of you. You're both lonely, curious, and wanting something interesting to come out of this.

Be careful, though.