It seems fine to me to say something like 'thank you, but I am going to use the time to run some errands I have been putting off' and then let it go. After all, they chose to help and wouldn't have signed on if they were not interested in the job.