Oh, you are definatly NOT being silly. I've seen people get beat up a couple different times---and both times, I was pretty "nerve wrenched" for a few days. And it's hard to know what to do in a situation like that; because you want to help, but sometimes there's nothing you can do. Even if there is, you can only do so much.

But no--you are not being silly--I'd be more worried if you didn't care. (P.S. I got a little emotional just reading that.)