((((krisa)))) Could you write a note to him on paper saying something like the following? So that you could have a physical piece of something to hand him for when he asks:

Your behavior towards me last week was inappropriate and unprofessional.
I have reported you to the board. I have been advised to not share my medical information with you at this time.
Please contact________, as they've been trying to discuss this matter with you for a week with no response from you.