I think Sannah may bring up a good point. You, as his wife, are the last person on this earth he'd ever want to have suffer through this. It might be his unwillingness to want to accept it more than doubt.
I would say, however, that pbutton is absolutely, 110% correct. Ultimately, your husband, whatever his intentions may be, has no right to imply doubt. And if it helps to talk about it or seek therapy, by all means, no matter what is said,
do it. The last thing you need to do is try to shove this under the rug...that never works, and harms instead of helps.
Please know you're in my prayers, and I hope things work out.
Hugs,
Harley