You haven't said if this visit means staying with you. If this is the case there are ways to give your brother and family the message you just aren't prepared for this - like offering to arrange a motel/hotel.