Are you seeing him for medication management? If so, I think that friendly chat you have with him can actually be quite helpful to him in assessing how you are doing. A pdoc can ask about symptoms and side effects, but talking with you gives them additional information, even if it just seems a casual chat to you. Pdoc is listening, combining his impressions with what you've told him about your symptoms, and drawing conclusions about how you are doing. If Pdoc wants to know more about your illness, he can ask. It's not up to you to try to guess what he wants to know.

I think talking to him about your feelings of discomfort would help clear the air. If there is something going on, he will have an opportunity to tell you.