Definitely work with your doctor to wean yourself off any medication--that way you have someone else to help you watch for side effects! Maybe ask for a different med to get your doc's support.

I agree that other tools besides medication from a psychiatrist are needed for most people to deal with anxiety in the long term.