Well, working 80 hours a week long-term is brutal, whatever the profession and setting. I would say if your department demanded that, it's the healthiest decision to leave it even regardless of wanting to have a family. I also relate to being upset about the narrow-minded wold view of people who otherwise have extensive education in a field that is supposed to understand and embrace diversity. I worked in academic environments like that and it was suffocating and irritating.