I think you need to straight up tell him it wasn't a date and that you're not interested in a relationship. Otherwise, it might become a mess.. so I suggest you to be honest from the beginning.