You might want to bring this question up with someone who has been sexually abused, but my general thought is that your situation is normal, given sexual abuse. I know that even if it doesn't lead to intercourse, it can affect a person's future sex life.
Have you seen a therapist to talk about these memories and your circumstances? I definitely recommend it. And please don't be embarrassed, therapists have generally heard most everything imaginable.