Honestly? Plan your weekends as you like. Tell him he has until a certain day to respond and from there your child may or may not be available. No reason to turn your life upside down accomodating him.