I would not tolerate that in my marriage. That would most definitely be a reason I would decide to divorce (and I am not one to be quick to say such things in my 30th year of marriage).