I think it depends what’s more important to you. Being a dom with multiple subs or being married to your husband.

Sounds he doesn’t like what’s going on. So you have a choice. If giving up your life style leaves huge hole in you, then perhaps you have to give up your marriage so you can have more subs.

What’s more important for you?

Personally if my husband had another woman as “more than a friend”, “had feelings for her”, I’d be done with him regardless if he had sex or not. You both have choices.