I agree with the others here that honesty with compassion is the best way. Being clear in a nice way so there wont be misunderstandings.

I know its not as easy as its being said when having to turn someone down, I have been there myself and its difficult, but honesty is the best way always.