I'm not clear if your father told you things about when you were a child or told you things when you were a child as you say.

Can you ask an aunt/uncle/sibling/friend's mother, etc. about a story or two to check what he's saying and how he perceived things? What sorts of things are you talking about; you could have had an "imaginary friend" like lots of kids have, and other "normal" situations you just don't remember because they're not particularly "important" to you. Or, my brother and I use to tease my niece (she's 46 now and the mother of 3 children, one of whom is getting ready to finish her first year of college) that she was a boy and try to convince her. Could your father have been a "big teaser?" How did your mother act in such situations? Just because you don't remember things in your childhood doesn't mean there's something wrong with your memory or what you do remember. We're all selective about what we remember and how we remember it and it's what you remember that is important for your life.