It's not you, some coworkers are toxic and take their frustrations on anyone they can. I agree it can take a toll on your confidence ideally it shouldn't ever happen but unfortunately it does and it still does. I worked at a coffee place with women and it was horrible, but now I'm in nursing and it's mostly women and guess what, it hapens here too, then I learned to stand up for myself and called her out on it. I transferred to a different unit in the hospital and it was so much better with better people. I used to believe 'oh it's just hormonal women' but that was just an excuse