Tell him you are flattered but you do not see a relationship with him happening.