You are not an idiot.

I would write a letter of what you want to say to him and read it at your next appt. I have done that in the past and I find it helps. Do whatever you need to do to be heard. If you don't say anything, he will never know.