I had a similar situation in my family. I was not directly involved, but it affected everyone. It came out in the open and it divided the family forever.
I have children, and I would not let them be around a pedophile.
It seems to me that your husband must know this. I believe in family unity, but at what expense? Would your husband be able to sever ties with his parents?