Have you talked to your therapist about it? Have you talked to your husband about it? I know when i get to that place, if really helps to let either my wife or a professional in on what goes on in my head. Maybe you and your husband can work on other things that can make him feel loved and you comfortable at the same time? When I got a rut, my wife and i will try to spend extra time together just cuddling or having a nice dinner. Maybe watch a movie that gets him pressure without you having to do much?
I would definitely recommend bringing it up at least to your therapist. You could then work on the trauma that causes the panic... ((hugs))