I felt exactly the same way you do just recently. I had the feeling that my T found me too difficult to work with because I have such a hard time trusting him and getting to talk to him about difficult things, that he thought I am a hopeless case and he just does not feel like wasting his energy on me.
I even thought that he had said that to me in last weeks session because afterwards I could not remember a thing of the first half. Probably got so scared that he would be saying this that I actually thought he had said it.

I already have had that feeling build up over a couple of weeks and once tried to write a bit about it in a mail but could not talk about the mail. Probably the mail got me so scared then last week...

After that session I felt sooo bad that I could not handle it anymore and scheduled an extra session to find out what he really thinks and what has happened.

And do you know what? We had the greatest session so far. It was difficult to name all my fears and bad thoughts I thought he has about me. But after all I got to hear that it is all wrong and what he really is thinking. It was purely amazing and has helped me to gain some trust in him now.

We also agreed that if I should ever think/feel that way again I will try to talk to him about it immediately.

So I really think it is a good thing to get over the fear and try to talk to T about those feelings. Chances are it is your fear and not a reality what he is thinking about you.