Well, he hasn't confessed anything about his feeling towards you, so you can still remain friends with him in the meantime. If he asks you, you can simply say that you're not interested in a relationship.
If you don't want to be friends with him either, same thing: just say it to him, kindly but firmly.