I think it's good you're coming off it, in the long run -- they describe some of its effects as being hypnotic and euphoric, which can't be good over a long period of time; I didn't like it. I was given it for sleep, but didn't take it for too long because I didn't like the way it made my head feel fuzzy, like I wasn't thinking straight -- even many, many hours later. I kept asking for a lower dosage, because the effects seemed so strong to me -- I guess I just don't prefer feeling artificially confused as the result of a medication that I am not even taking for any psychotropic purpose. I went from 50s or something, to 30s, all the way down to 7.5s, but even that made me uncomfortable.

Is your doctor giving you something else to take while you're tapering off it? This is from wikipedia: Gradual and careful reduction of the dosage, preferably with a long-acting benzodiazepine with long half-life active metabolites, such as chlordiazepoxide or diazepam, are recommended to prevent severe withdrawal syndromes from developing. (x)

Especially if you're experiencing a lot of physical distress, it seems like it might be well worth it, if there isn't a contraindication for anything else you might be taking.