How small? If you don't have very many words, you don't "remember" much because there's no way to store it. Everything in our head that we can remember, is in words and the words bring up pictures. Sometimes we can get vague pictures or feelings without words but if you want to "see" what it is the pricture is about, you have to be able to put it into words! A bit catch-22 but that's why little kids don't remember much, because they don't have very many thought processes at the time that use words or very many words.

Do you have an older aunt or relative you could talk to about your childhood and what they know or remember?