I would recommend you stay on them.
I went off of mine every time I felt better since I've been diagnosed (I was under the delusion I wasn't bipolar though.) and would fall back into the mood swings. I learned the hard way (running up a lot of bills for emergency visits) that I needed to actually take my medicine.