Well... being 71 I accept I am, in fact, elderly (physically at least. Mentally / emotionally is another story entirely.)
I don't have the "young doc" problem... yet anyway. My primary care doc is roughly the same age I am! He comes off as kind-of a sourpuss. I don't have occasion to see him often. But the few times I have, he's done a good job for me.