Maybe it is because you had your "fantasies" so long and never really build satisfying relationships in real life? Because nobody will ever fullfill your fantasy critizeria. And unconsciously... you fed this over the years.