No, I don’t think you’re being a jerk.
I’d be so cranky if my doctor kept forgetting things about me. Good doctors do a quick once over your notes before you enter the room.
Mine does ask the same questions often but that’s because the answers are different.