I think he is reasonable. He doesn't know if you really have the same feelings for him and its natural to recoil away from something that doesn't show 'promise'. Maybe you are giving him mixed signals?

You have to ask yourself whether you want a serious and committed relationship with him or if you're just interested in a good time. It sounds like he is looking for a serious relationship and you're on the wall.