Hi WovenGalaxy, I am sorry that I don't know your history so I am just going to say what this might be.

Sometimes this kind of challenge stems from either not having a father figure growing up, and other times having one that you never experienced a true closeness with.

Does that ring any bells for you?