Agree with others, you have no obligation to be his friend. Slow fade as you are doing seems kindest. Being his friend when you don't like him would not be a kindness.