It's a theory, is all. He's trying to fit in all of you, what you're telling him and what you are "manifesting" in his office, etc. Adult ADD is not like the kid's version. Like everyone says, I would talk to him about how the suddenness and seemingly far right field of his thinking and how that effects you, see if you all can come to an understanding of where each other are coming from.
http://psychcentral.com/addquiz.htm
http://www.adhd.com/adults/adults_add_screener2.jsp