Big people have the disadvantage in some situations that they require more food than smaller people. So evolution would select for smaller people in situations where food resources are more limited. Variability in size and other qualities is good, because that means adaptability of a population to different conditions. So just think of the advantages of being smaller: you can more easily survive in conditions where bigger people would not fit!

Not really kidding, either, though you might not see the advantages...