I think after two dates you have a good sense of whether you are attracted or not. It seems he doesn't quite fully do it for you. I would say that is most likely going to continue to cause a problem. If something is not quite all there after two dates, you kind of already know.