Maybe you can go back to just doing it with your husband. Did you both enjoy it when it was just you two? I see nothing wrong with whatever you do, if you both enjoy it. It sounds like your husband just draws the line at bringing others in and feels jealous and that is not pleasing to him. Can you forego the others and still have the dom/sub relationship be satisfying to you both?