Could you play it of as an anxiety attack. You could also say you don't know. If you talk about doctor appointments mention you had/have one and talk about it.

Usually my conversations go like this:

Mom:How'd your appointments go?
Me: What appointments?
Mom: You said you had appointments thursday?
Me: Oh, they went fine. We had all our therapists appointments and Dr. M change me to X med.
Mom: Oh,
Me: So did you win at bingo?

I treat it like anything else. My family knows I'm on meds (usually which ones) and it's Bipolar but they haven't asked anything else so I don't volunteer. My grandma always asked me how I was doing and I couldn't lie to her. She like had a superpower like that. So she would ask if my meds were working. When I see the dr. things like that.