I'm a survivor of childhoo sexual abuse and I "forgot" til I was around 19 years old. Then I started getting recollections. From my underatanding when you experience traumatic events as a child your mind will block or supress them from your memory. Sometimes a situation, smell, event, etc will trigger a memory out of suppression. Thats what happened to me. I also have trouble remembering many things as a child. I have blocked out so much. I hope this has helped. You mightcvonsider speaking to a therapist just to see if anything may come out of it though it certainly seems, from what you described that something did.