If push comes to shove, you can always block his #.....
It might be a safe practice to not give out your phone # at first. Not until after a few successful dates with the same person. An email should be more than enough to suffice in the beginning, (you never know who they REALLY are).
Your safety is primary...
Shangrala