It is easy for people who don't understand bipolar to be cavalier. But they are wrong, regardless of any degree they may hold. Stay on your meds. Sure, adjust if necessary with the consultation of your p-doc, but you *know* how serious bipolar is and you shouldn't listen to someone who clearly doesn't have a clue, even if they *think* they do.
Btw, there *is* a book called Bipolar for Dummies and it is quite good! To the point that I've read many many, but actually OWN that one to have something on hand that can help people start to understand. (I don't believe anyone who doesn't live it can actually understand, but it can keep them from total ignorance, and hopefully from unhelpful attitudes...)