I'd certainly put test-subs into their own package, if they lived in the same file.

That does not reduce the overhead problem I mentioned — the test-subs will still be compiled every time the module containing them is loaded. Only putting the tests into a separate file solves that problem.