OK, I figured this out:
When running PERL on IIS, make sure that the PERL.EXE is setup with %s %s in the application configuration of Internet Services Manager.

Also noticed as a hint to everyone that if your default page is set to "default.htm", you should also setup OJ's main page as "default.htm" as well, index and default don't seem to work well together under IIS.