How did you get your Pdoc? Was it a referral by your family doctor or did you find him yourself?

From what you've told us, I'd be concerned. Is 10 minutes the usual time for Pdoc's in your area? Did you ever have an "intake" interview with your Pdoc or an assistant of your Pdoc where they asked you like a million questions?

It's hard to get a real view of ANYONE in 10 minutes, let alone of someone who you see only 3 times in a year and of someone who you don't read corresponding notes about.

I'd either ask him for more time, an explanation for a his diagnosis and comments, or look into seeing someone new.

Warning signs (in my opinion) include an inability or a refusal to work with other healthcare providers. If your doctors aren't working together, then it's not to your benefit.