Thanks.
I had the realization just recently that I'm looking at it from his possible point of view. Thing is, its all about him. And he does not. know how he affects me nor am I completely sure he can cope with it if I tell him. And that can be ok. But not for a close friendship.