if he is too tired from work, then can you two negotiate something like being free on weekends? or waking up early and doing it before breakfast?

like - being tired from work is a valid excuse. totally. but if that is the only reason, then there are ways around it. if he really does understand that this is an issue for you both, then he might be interested in trying out other ideas.