Sometimes the fit isn't right. I got lucky on the first try but I know people have had to go to a few T's before they found one they're comfortable with.

I had to do that with P-docs.

Sometimes though, it could be he's pushing your buttons and he's hit something that brings up those feelings you're having.