Lithium is not a common cause of sexual side effects, but all psychiatric meds can do a number on you. See a discussion here.