It might just be me but it really doesn't sound like you were saying anything more than that you are fond of him which is nice and nothing at all unusual, you just state that you are feeling a bit attached to him really. I'll swim against the current here and say if you felt so bad about him not responding to these remarks then perhaps just leave it for now and bring it up when you are feeling better about it, if you still want to.