my dad was a freak and wouldn't let me leave the house with my hair being in a ponytail, because it should be long and flowing. I still give him grief about it to this day! (he's a changed man and now apologizes and cant believe he was like that)

but i agree that it is based on your own confidence. Men are attracted to many different things, the length of your hair shouldn't make one iota of a difference. And for the men who don't take a second glance bc you have short hair--you don't want those men anyway!