There aren't even always two distinct human sexes. There are intersex people who are sometimes born with male and female sex organs. And some of them look like girls on the outside until they hit puberty and it runs out they were male and had testicles inside their bodies. So gender is not binary, but neither is sex.