I'm the exact same way and I have been working on it for years. Really, I can logically see gray areas, but when it comes down to my feelings, it is either love or hate, for or against, bad or good. Its something that comes up on nearly every visit to my t/pdoc and I still haven't found a way to not do it.

Edit: I didn't realize this was considered a bipolar thing, I always assumed it was because of my traumatic childhood.