If you decide to go for casual sex please use condoms, that is the main thing I think of.

Want you to be safe.
What happened last time you were with him? Are you putting yourself in a dangerous situation here?
I'm concerned about you saying that you don't have much time, why is there a rush? You might want to tell him you need to think about things more. Give yourself some more time.