My husband and I are going through something similiar. My husband and I try to talk about the issue, sometimes it helps, sometimes we end up fighting because of it. and I have a low sex drive associated with possibly the PMDD and the birth controls I was on.
I can relate it is very frustrating. Have you tried going to therapy yourself and finding out your feelings on the subject with out your husband's input?