That's the thing. Breasts are seen as sexual and turn men on--so it sends the wrong message. Women aren't necessarily turned on by men's chests.