I'd think about what this guy has to offer and what you want. Personally, I'd give him a miss. I know that this kind of guy would probably leave me worse off than I was before we got together.

A lot of it would also depend on just how deep the feelings were, though. He sounds more like fling material than relationship material. So if I was just casually interested and centered enough to keep things that way, then I'd consider it. Would he pressure you to do things you're not comfortable with? Would you need things from him that he can't give? Are you comfortable enough with yourself to say no to things you don't want, mean it, stick by it, and make the tough calls for your own well being when needed?

Think about what the situation would really entail. If it looks like it's going to mess you up, then wait for the next guy. There are certainly more out there.