It sounds to me as though this relationship is developing nicely.

I think it would be okay, and good, to say that you wish you could see more of him.

What if you just continue in the relationship and see how things are in six months or in a year?