I'm so sorry this is happening to you. I'm in a somewhat similar place, where I have faint memories of "suspicious" behavior from my stepfather and very little memory of anything else. It's tough, not remembering what happened, and not being certain whether or not you can trust the things you do remember.
It's ok to be confused. Whether or not specific memories turn out to be perfectly accurate, your feelings are absolutely real, and I think they're a good guide for you. We're here for you as you figure things out and deal with you family. I hope things hurt less soon.