Sounds like a very confusing place to be in. I get anxious when I'm in a mixed episode, but when I withdraw, it's usually because I'm getting depressed.
However, sometimes when I'm in a mixed episode, I am so irritable, that I withdraw from people, because none can live up to my expectations.
What did your pdoc say wrt how long it should take for your meds to kick in?
Try listening to soothing music