I think it's important to trust your gut. If you don't feel anything but negative towards him there's a very good chance it's not a good therapeutic match.
Can you try out a few more and see if you find one you like?
And the phone thing would be a deal breaker for me. I would not accept that from a therapist.