It sounds like he was worried and that's why he called in the team. Perhaps this was a poor choice, given that you hadn't liked dealing with the team before. It seems like you felt pushed by his suggesting a time (as opposed to offering, as he usually does)? Maybe you can make an appointment to discuss this with him--he may not have realized how you were feeling until too late?
I'm sorry the appointment went so poorly.