For my test programs with a test helper library in t/MyTestHelper.pm I use something like

use lib 't/';
use MyTestHelper;
[download]

This picks up the library when the tests are run using make test or prove.