I can only speak for myself, but even though I'm strictly heterosexual, I'm not sexually attracted to every women I meet. Some I am, some I am not. So it's not just the gender of the other person, but a list of qualities that makes certain women sexually attractive to me. I've never met a man that had that list of qualities that include physical as well as emotional traits.