I don't think that sounds soulless at all. I think that can open for a more true understanding of others. You don't feel what they feel when you empathize, but you treat them as people that have value, and this sounds like a good basis of fairness, not getting dragged into the game who is worth "more". If that is the case, I see that as a deep kind of caring that many people lack.

Also, if you are not very emotional with people, maybe also you don't project emotions in the same way many do? Sometimes reasoning is the way. I notice several who are more emotional in their approach to others, empathize based on their own feelings. (I mean, seriously they cannot truly feel what others feel so it must come from he inside.) That means they run on emotional instinct which is actually a rather crude tool. I'd rather have someone just theoretically empathizing with me, if they actually on some level get me. Rather that than someone feeling bad when I feel bad, or happy when I feel happy and are clueless why.

I'm not really dissing any of the kinds of empathy people show. We probably need more than one kind to have a good society.