I filed for SSDI and was sent to a pdoc for an evaluation. He told me point blank that he didn't think I could hold a job.

How much weight does the pdoc's opinion carry with SSDI? Is it more likely I'll be awarded SSDI if the pdoc agrees, or does it matter that much?
Thanks!