I don't have complete memories of abuse prior to age 5 or 6, but I have a lot of fragmented memories that I am not sure where or when they came from.
I do believe that babies who are raised in abusive environments are impacted by that abuse for sure. They might not remember it, but it impacts them through being hard to console, showing anxiety. So many ways.