I've been thinking about doing the same thing at work ... however, I was thinking of doing it still under the Module::Build framework so I could just Build test. And then I could "Build test > logfile.out 2>&1" to get the full output (assuming I was on unix - I can't recall how to redirect stderr and stdout to the same place on DOS/OS2/Windows).