I would not take the question personally, it is nonsense to me; like asking, "Do you walk to school or carry your lunch?" I would answer him, "I do not know, I do not wish to go off my medications." His opinions on your state of health and use of medication don't count for much? He is not you and lacks any sort of knowledge/education/experience on the subject.