The only people who are going to come out and accuse you of milking the system, don't matter; they're ignorant, thoughtless souls at the moment and a pleasant putdown

as in, "Thank you for your informed, thoughtful, understanding and kindness in asking that personal question, the answer to which I feel is none of your business" as you turn away can go a long way? You have to explain yourself to lawyers, doctors, the Government, professionals who are trying to help you but not to their lackeys who don't have your information in front of them and have their own axes to grind for whatever reason.
And, if the professional expresses themselves badly, like this vision guy did, you give a cheeky reply, "I'm doing quite well, thank you"

and then, depending on their response (if they "get it" and apologize you let it go) correct their clumsy expression of "How are you on Medicare?" by asking, "I suspect you actually wanted to ask about my medical background and prescriptions, not make a personal comment or political statement about my age, income, or work experience?"