Possible explanation - People who grow up to be perpetrators think that you are either a perpetrator or a victim. It doesn't occur to them that there are other paradigms. Your dad most likely was abused but instead of healing or doing what most victims do (never harming anyone like they were harmed), he chose to be a perpetrator so that he wouldn't have to feel like a victim anymore.