in reply to Running a set of tests twice

For the aspect of avoiding duplicate tests, you might want to take a look at how mod_perl approaches this - many of the apr and apr-ext tests use the same test subroutine in the appropriate module in TestAPRlib to run the actual tests.