I feel for you. I would be overwhelmingly self conscious about it. However, I know, at least where I work (and it's mostly men) they will only say something if they like it, and they will say something nice. Usually, they say nothing, cuz they're guys.
If you like it, that is all that matters!