Dude. No, don't apologize for that. He should apologize to you if anything. Whether you're angry isn't the issue here (except in that your feelings are always the issue), the issue is he needs to get a grip. His feelings are really not your problem, that's the main point of therapy versus, say, friendship. He should know that.

As an aside, little makes me more ragey than the notion of therapeutic holding. I'm a fan of therapy, yes. It has helped me tremendously. But therapists way overestimate their ability to provide enough support in their extremely limited context. They essentially drop you every week. So they need to get the fuq over themselves. Of course you don't feel held by their sorry fifty minutes. Of course your imperfect but caring parents hold you more.