Context. It all depends on the context of how you know the person, where you interact, and why you interact.

Coworkers you can sympathize with.

Family members and friends whom you are close to, you are more likely to empathize with.

Acquaintances you can sympathize with.

You can learn to empathize through practice.

Empathy vs Sympathy - Difference and Comparison | Diffen