Obviously it is risky, and most of us are not going to say,
"yeah, good idea, go ahead."
But I will say that I respect your decision. You have thought about it for long weeks and weeks, so it is not impulsive behavior. It is well thought out and planned.
To compare to myself...I planned for long weeks and weeks to have a casual sex affair, and I finally did. I didn't regret it at all and had fun. When I posted about it here, of course most people were like,
"oh, you are hypomanic, be careful, you are making crazy decisions!"
I was just like,
"nah, it was great fun!" 
It WAS NOT impulsive, like just suddenly sleeping with someone out of nowhere. Just like your going off saphris was not impulsive, but well-planned. So maybe your decision is a bit risky, as was mine, but in the end it is your life and you decision. Good luck babe!
__________________
Bipolar 1 ~ 300mg Lamictal, 4mg Ativan