It does sound like he stress out as well, taking that stress out on you. Which isn't healthy but does happen. I think you both need to sit down and talk about what each of you want of of the relationship; and if you still see eye to eye with the relationship, then I would try you both trying hardier, and you both giving each other some breaks. If that can't happen then maybe I'd look at end it.