It's through scientific study and research that this has been established and not really arbitrary. The age at which we begin to retain memories that last through adulthood is just part of the time table of individual cognitive development, just like puberty or any other time-sensitive process occurs as part of physical development. There's some variation, but as a rule, certain things happen to the vast majority on a timeline, in a sophisticated interaction.