I am realizing too that I don't remember much before I was in the 4th grade. Perhaps it is a blessing like Stumpy said. But I am remembering more, and the bad part of that is, I wish I didnt' know now.
I know it is frustrating not to know, it sounds like you are trying really hard to get better, but be kind to yourself. You can't help it if you don't remember.