Will you have another chance to talk with him about it soon? Are you afraid he will say no? Maybe it would be better to ask him in another situation in case he says no you can feel some what comfortable expressing your dissapointment.