I think that the relationship is very important, along with having a knowledgeable therapist. I went to a CBT/eclectic therapist for quite awhile, and it ended badly because I was unable to terminate the relationship when it was not helping me. Now, I know it was for the best because I now have a therapist who understands me and knows how to help me.
It sounds like you are at a place where both of you agree that something is not working, and that it has been that way for awhile. I would feel the same fears as you do.

Can you get referrals from him for different types of therapists and then go out and interview while you are still seeing him? I thought that I wouldn't be able to find a therapist who was a good fit, but I did. Keep us posted. Take care.