First of all, congratulations for getting thru college. It's a huge accomplishment.

Sounds suspicious that he wants to talk to your doctor. I don't think the doctor will do that for privacy reasons (HIPPA) without your permission. Besides being none of his business.

I would inform the disability group at school about his behavior. He is supposed to be making allowances for you.

You can also get a letterhead from the doc that say you "were under a doctor's care", being non-specific during the time you were inpatient.

Sounds like he is just an everyday ****. I'd do everything possible to escape his attention in the future.