Stopping AP can cause psychosis, even if you never had it before.

Look at it this way. Your "crazy" is your brain's normal. If your throw mind altering drugs at it, brain tries to compensate to get to its "normal". When you stop the meds, your brain is in overload. It takes time to get back to your baseline. Worth to wait it out, so you are not medicating withdrawal effects, further screwing up your balance.