I don't think saying you'd look good with short hair equates to your hair doesn't look good. I think it just was an in-the-moment thing where he saw you with your hair pulled back and had the thought that your hair would *also* look good short.

I wonder too if he was thinking that perhaps you 'hide' behind your hair?