Yep, my t asks where I've gone and I usually just say I don't know. I don't think she's calling you out, I think it's be ok to back track and say "oh maybe I didn't hear" she's probably asking because she suspects you didn't. By repeating it back she can try to make sure we understand what they mean rather than what we hear-sometimes it's not the same