That pdoc's opinion does carry a lot of weight, and it is a good sign that he told you that he doesn't think you are employable. That's what he is going to tell the SSA.

On the other hand, he's only seen you one time, if I'm understanding you correctly, and his opinion may not be enough to convince the SSA. They would be more convinced, if they heard from a pdoc who has been treating you over a period of time.

If you have not been getting treatment for your condition (from a pdoc,) then they might want to see if getting treatment could help you be able to work.