It sounds like you have been going to this T for quite a while, and perhaps in that time he was able to put together things you said and things you didn't say and how you "acted" at the time of thoses disclosures. I think it's very brave of you to answer him, and it will help in your healing process. That he let you know it was "out of the blue" and that you can leave it until you're ready sound like he is really caring about you.
Don't beat yourself up over any reactions in therapy. If you could live just fine the way you have to act in public, then you wouldn't be needing therapy, the therapy relationship, and the safe therapy office. imo.