I think most of this is physically independent, my brother, and most in my family, have adored caffeine (coffee drinkers) and haven't seen anything that lives up to this problem of the mix, but we are all physically and mentally, individual(s) but I feel whatever seems to not agree, caution should be taken, and being in touch with the prescribing pdoc about this is important.
Some people get stimulated from caffeine, and then there are people just the opposite occurs.
Lithium is an excellent med. for many, then there are some it may not be good for, just a matter of giving things a try and following all the directions and also reporting to your pdoc if there are negative side effects, some effects are only temporary, but it's best to take this up with your pdoc.
I wish everyone here, at this forum, lots of luck with their meds and on the road to stabilization.
It is possible.

DE