There are definitely times I want off ALL meds, including my meds for chronic pain. As BirdDancer has mentioned, I then must consider why I am on them in the first place. Once I think of how it was before meds (not prior to illness onset), I reconsider and work with my doctors to try to tweak meds to minimize side-effects.
I hope you will work through this with your therapist and your pdoc. You are a super intelligent person and you never come across as lacking cognitively in any way; yet, only you know how it is for you.
With Love and Admiration,

WC