I know its scary, I was in your shoes 5 years ago. The only symptom I get from lithium is being almost constantly thirsty. I don't like taking the little pink pills either, but it helps stabilize me.
Maybe you will get side effects and maybe not. Try it and see what happens, I'm sure you can transition to something else under the care of your pdoc.
You're going to be okay.

I'm Bipolar Type II with Psychotic Features.