All or nothing thinking is the bane of my existence. I do this with just about everything. You could use CBT to overcome this cognitive distortion (I’m talking to myself here as well).