I wouldn't explain. If you want them to take the initiative, my thought is to say something like:

"That was really fun. Thanks for coming! Let me know/give me a call/message me if you want to meet again. I would really like that."

(They might not do it though, and then you won't see them. But I guess your point is that even when you take the initiative you often don't get to see them.).