Some people are more naturally empathetic than others. If you survive a tornado, you will naturally feel something when another story about another tornado comes on TV. If you live in a safe area, it will feel more irrelevant. Most mature people will feel a certain responsiblity and empathy, a connectedness, to those in their community. ie you don't have to have a child to know how much it would hurt to lose one. Also, being aware of issues in your community is a civic responsibility. Our form of government relies on people educating themselves and taking an interest in important issues. So, yes, I do think it matters.

I would worry particularly if your lack of empathy becomes callousness. In it's extreme, it would be considered a hurtful character flaw.