My thought is you have to be more assertive. Your husband needs to know exactly how his unilateral withdrawal from sex is affecting you. Telling him what you told us is a good start. If your bipolar causes problems in the marriage, would he expect you to get help? I think you have the right to expect the same from him.

Good luck.