I've been where you are .... I stopped my meds once too ... and honestly? It did not end well for me ...
The things is, certain meds will cause very abrupt withdrawal symptoms, not only psychologically, but phsyically too.
And for some meds, if you're considering going back on them, they need to be tapered from the beginning again in increments going up, so you'd still need your pdoc's input.
Regardless of what transpires, may it be the decision that serves your own mental health well in the long run.