I hope it helped you feel better to "come clean" but what you're describing sounds pretty much normal for a young man. To a heterosexual male women are attractive...sometimes very much so.
I'm sure that your experience being sexually abused makes this all really confusing and hard to sort out. I'm glad you posted about this just to ease your own mind a bit I hope.
You aren't doing anything wrong. I was exposed to sex by older girls and women at a too young age as well. It does confuse things later on. It can be sorted out though