You sound a lot like me, June...
Have you been hurt in the past, and spent much time recovering? This leads us to question even the smallest attraction, and what could potentially unfold.
(I am much the same!), but I would suggest, as others have done here, that you try to relax and get to know the fellow, who obviously enjoys your company and wants to see you!!!
Seeker "Patty"