I think that could be a good idea, yes. It sounds like you already tried communicating and he wasn't particularly forthcoming. So perhaps step back now for a while? Don't call or text. Don't set up more dates. Occupy yourself with other things for a significant length of time and see how he responds.