What, this is a rather strange behavior. If your doctor is a good professional and you don't want to lose him, I would recommend that you try to talk to him about it.