Are you sure your wife is "against" this? I know my memory of details of the long past was such that everyone (my stepmother especially) would comment on it and sound critical but they were actually just kind of in shock because they don't have such memories? It took me a long time in therapy before I could tell the difference my stepmother once commented on, "It's not a criticism, it's just an observation". I was so use to her criticism and defending against it, I had no room left to tell the difference and "accept" any observations. It sounds like your wife has a problem with your memories

Think about that. She must not have any good ones from that age if she's afraid for you?
Or, just tell her you are working on it with your therapist. My husband sits at a table to eat and has one arm resting on the table and extended a bit. It looks a little odd and once we (the family) mentioned it and he thought about it and suddenly remembered his mother use to "steal" his french fries!

So, he had the arm out there curled a little protectively around his plate to ward her off and the habit stuck.
Who knows; maybe you remember and like discussing what you ate because there was a lot of talk around your childhood table about the meal and it was enjoyable to you. She wants you to give that enjoyment up?