I understand why you wouldn't want to be on Depakote. I've read about it a lot and from what I understand it can have some horrible side effects. In fact, you can have side effects even after you stop. I'd rather be batsh*t crazy than take that stuff.
However, I agree with everyone else who is telling you to taper down slowly. Most of us have stopped taking certain meds for different reasons and we are speaking from experience.