Yes, you can set up your local machine as a web server, but you'll need to install some server software: looks like apache has a Win32 offering.
You can also run your CGI from the command line and have the script output to an HTML file rather than to STDOUT, but this isn't quite the same (although it can be a good technique for building a large static site).