Jellybean is a portable, pure-Perl application that can serve CGI scripts even on a Windows box. It's easier to set up than Apache.

However, it's not well-tested under Windows.