I think sex on the second date on its own isn't necessarily a problem. What my suggestion would be to OP: inform the guy before the sex takes place that you're not looking for a conventional relationship, and that living together later or marriage are not options for you.