I would tell your dr that you wanna come off and if he waivers put your foot down. Tell him you need a plan to come off before end of session.
I wrote a 2 page letter to my prescriber(an NP). Im hoping she has time to read it before Tuesday cuz I want to schedule an appointment for then and discuss it. It told her not only why I want to come off but how I plan to help myself coming off and when im off.