Well you can ask to see your file. Every patient has a right to see their file if I remember correctly. I don't think you should be so scared of asking. He will probably understand you wanting to know. The time with your T should be yours so if you want to ask what's wrong with you I think you should. But then I don't have a lot of experience with these things, it's just what I think.
Good luck