It might not just be crazy, but in some cases possibly even dangerous to do. There can be nasty consequences in some cases when drugs should be tapered off. It's best to leave going off medication up to the prescribing doctor.