Since he is a psychiatrist, a medical doctor, I have a little less problem with becoming friends with him, especially as he was your doctor when you were a teen and now you are all grown up; I would treat him like you would a teacher after you grow up?

Especially true would be if you are in the helping profession or similar field now. He would be a colleague then as well as potential friend.