Are you saying you seem to like this guy more than he likes you? And that he is just dating for fun and you want more? If that's the case, if something in your gut is saying this is the wrong dating fit, listen.

In regards to your questions of whether to drop him or wait and see if he changes...I guess it depends. I don't feel I have enough info to advise, but I've been In situations where it was clear I felt more than the guy, and it was quite soon into it. I waited and wished I hadn't.