This would not go over well with me. I would insist my husband cancel if it meant that much to me and get a hotel for the day with room service if he invited them anyways. Seriously, put your foot down and say "it doesn't work like this". As long as your husband isn't developmentally delayed he should understand.