Looks interesting; I'll try it out. I would like if some of the dependencies were optional... ('Test::PerlTidy' is really more of an author-only test, for instance.)

But it looks like something that might usefully be added to a Kwalitee score to me, eventually.

Edit:

One thought from looking at it: I'd want all_plans_ok() exported by default. It's kinda the point of useing the module...

Also, the message Failed test ''t/002_basic.t' does not have 'no_plan' set': You mean it has no_plan set. Not that it doesn't.