I have done both - come off drugs cold turkey, and come off others by tapering. I have to say tapering is best, and that can be hard enough. But if you are determined to just get through the withdrawal effects, you can do it all at once. It can make you feel really ill physically, apart from the effects on your bipolar.