If I had to guess I would say that your theory about the relationship (or lack of) with your father is right on.

I've done the same thing with females my whole life. Nothing sexual. Always older than me. And like another poster said, I've pushed many away.

The only reason that I can guess would have contributed to this is that I never attached to my mother. I care about my mother, she's done her best, but she was a self-admitted out of control and unpredictable person when I was growing up. We still don't have a good relationship. This has convinced me of the power of past relationships with our parents as causing us to crave and seek out similar relationships in adult life. Especially when the relationship was unfulfilling.

Mine was my mother, yours was your father. You're probably right on there.