I'm on AD and a mood stabiliser, but stopped SSRI, mainly due to the fact that I had issues with the side effects (Well, no libido).

I'd be weary of just not taking the SSRI - bear in mind that your brain has effectively been "re-wired" due to the drugs, and they cannot just be stopped, but need to be slowly tapered/weaned off. I was on 20mg SSRI (Lexamil) and stopped cold turkey and felt TERRIBLE!
You need to discuss stopping medication with your doctor and only do so gradually, allowing your brain time to adjust.

If it is keeping you up, can you try take them in the morning?

I now take Edronax - much less side-effects, and helps with my lack of energy; I take these in the morning though.