If you are having concerns with what he will or won't say at the doctor's, you can (at the doctor's) just ask him to remain in the waiting room until you're finished. The doctor and staff will support you I think. It's great he's concerned about your health and working hard to get you to do what you "should" but once he gets you there, it's up to you to take care of your health; no one else can do it for you.