I range from a 4 to an 8, depending on the brand. I definitely wear a smaller size at stores like Target and Walmart than at stores like Bebe or Nordstrom. Maybe I'm biased because I'm about the same size you are, but I think a 4 or a 6 is pretty average and not particularly small.