My advice is comply with your meds. If you don't like something or feel like it isn't working, do not take yourself off it, talk to your pdoc. I'm saying this because compliance is a huge issue with BP.
I also recommend exercising when you are feeling good. That way your body will be healthier when you are in a slump.
Identify distracting activities that make you feel good—art, writing, walking your dog, etc. Try to engage in these when you are depressed.
Hang in there