Not wise. I would seriously rethink this decision. I know you're mad and upset but you'll only be hurting yourself. You will be the one with the chills, sweats, delusions and/or hallucinations scared out of your mind. Just make an appt with another Pdoc or go to the ER for help with a taper program or your family doc, anything would be better then the Pdoc you did get to see.
Hang in there, call a hotline for advice, if needed.