Yes, I think you're right that it should be in Test::Harness or something similar. However, I would like to see readily available hooks available, just as we have (?:make|Build) test.

If all dragonchild wants to do is install modules, though, then Module::Build is a bad name.