I can be the same way. I think of myself as having ASPD for that reason and others, but I've never been officially diagnosed or anything.

At the same time, I think that there are possible experiential correlates to my "condition", which is similar to yours. Because of that I'm moved to ask a question:

When you were growing up, did you experience a reliable stream of emotional warmth--from anyone--that was unequivocally genuine? that was consistently paired with truth? and that followed you into dark corners--even those of your own design? My thinking is that, if you truly experienced that kind of warmth and compassion, it may have become a part of your emotional programming. Perhaps, if you were like me and experienced for the most part the fruits of others' sociopathy and questionable "compassion" while growing up, you simply didn't have the experiential foundation to adopt a more ideal emotional composition.

Disclaimer: I'm not a professional; I'm just a self-curious and self-conscious person on a mission for understanding.