I agree the teenage boys might be okay but I'm with you about not wanting your preschool child alone in a strange situation. Maybe compromise by staying in the same bedroom at his house (his children he gets to say how they might be) but you and your son having a separate room on the vacation? Promise him some time alone on vacation after your son and his are asleep? (maybe get a "house"/suite instead of just hotel rooms).