Perhaps you could just have a conversation about it? Now that you guys have been hanging out for awhile, it wouldn't be unreasonable to ask him where he sees this heading. You could tell him that you enjoy your time together but since you just got out of relationship you can't offer anything serious, and that you just wanted to be forthcoming and honest about it - ask him if he is happy with the casual connection too. It's always best to be on the same page!