For me personally, I would not like that comment. If someone said it to me, it would probably mean that I was wearing makeup and a dress, or at least something more womanly than jeans and t-shirt or athletic shorts and a t-shirt. I generally don't dress very "womanly" so that's how I would interpret it. I think it depends on the context and if at that moment, you clearly look differently than normal.