I've done this a bunch. You don't have to tell them anything. They are service providers who serve us. Would you feel like you needed to tell your hairdresser or dentist or whatever?

A time or two I just left a message saying that I found a provider better suited for me and moved on.