I find that when I feel like this it could be:
a. T really isn't getting it
b. I'm really feeling crappy and I'm projecting (feeling annoyed with myself, and instead, accusing him of being annoyed with me

Usually when this happens, I just call him on it. Sometimes he will say, "you are right... I wasn't being very empathic there." He will ask me what I would have liked him to do/say.

Other times, he helps me figure out that I am projecting my feelings onto him.

Some sessions, we connect-- others we don't. There have even been sessions in which he says he felt connected, but I said that I didn't. Best thing to do is speak up and try to work through what's going on.