The things you're talking about are the very reason that I created prove, included with Test::Harness. Take a look at some of my testing talks at http://petdance.com/perl/. Also see http://qa.perl.org.
Currently I'm testing Perl and PHP with a whole ton of *.t files.
xoxo,
Andy
Comment on Re: using Test::* modules for generic testing of non perl stuff?