It sounds like he's not thrilled that your dad was giving you a ride to meet him and that he'd have to meet your parents first, etc. At 27 that is a bit of an odd request, especially if you had sex with him when you were only 13. I think he's wondering about you and who you may have become as much as we're speculating about him.

I would either go visit him for lunch somewhere, public restaurant, middle of the day, travelling there by myself and making the decision if I wanted a further relationship with this guy or I'd give up trying to get together and talking to him as it doesn't sound like it is going to happen.