If you want to stop, do it when you're ready. You won't be better if you stop taking the benzos when you haven't figured out your anxiety. Benzo = tolerance = working on coping mechanisms, no coping mechanisms + stopping = worse than it could have been.

Diazepam (Valium) was prescribed to me to take when ever I needed to sleep due to Xanax withdrawal. I got 14x 5mg prescribed twice. I'd take 2.5mg and that was enough for muscle relaxation.