Green,
Whether or not he has shared anything personal with you, isn't the point, the point is you did go out with him socially several times.
It would be unethical for him to treat you because you already have a social relationship with him. (even if he acts anti-social) Now if you were to just ask his opinion (off the record) when you see him, that is one thing, (he may be unwilling to say anything in this way too) but to see you as an actual patient would be wrong and I am sure he wouldn't be willing to do so.
I hope you don't get hurt in wanting this and not getting this, Green, he is only doing what is ethical. ((((Green))))) Take care of yourself, okay.