I would certainly call/share with your pdoc your reaction and work with him to adjust the work so it is not as difficult for you when you are not in the therapy situation.
Good article on exposure therapy for anxiety (choose on left tab of link page):
Therapy for Anxiety Disorders: Cognitive and Behavioral Approaches