It depends on both the man and the uniform.
Normally, hey, a man in uniform sounds cute.
But then there are "men" in "uniform" like a scrawny server at a local diner, looking like overgrown 12-year-olds in polos and aprons. I'm friends with a few of those.