You love him because he is your brother but you don't like him, he's not a friend. Think of your friends and why you like them and see if he fits; he probably doesn't. I have 3 brothers, only "like" one, despite being close to another where I live now and whom I see "often".