I've found Test::Group to be particularly handy at taming sets of tests that I want to run as a unit. So instead of having $tests_per_file * $file_count tests, I use Test::Group to make a single test that combines the $tests_per_file individual tests.

In this case, it may still not be enough. But, I did find that this approach tamed some of my tests.