So your husband knows about the affairs? If you have the money you should get a marriage Therapist and an individual therapist for each family member. I don't see why you need to remember. Do daily little things for your husband to show him you care. Texted him while at lunch. You have to individually have to deal with your bipolar, issues and remorse. He has to individually deal with his issues, anger and learning to support your bipolar and you have to deal with it together.