Yes, it can definitely be abuse if you didn't say no.

I also struggle with feeling like I am making things up & have a lot I am unable to remember. You're not alone.