You need to do the unshift in a BEGIN block:

    BEGIN {
        unshift @INC, "/temp/packdir";
    }
[download]

This is necessary because use is a compile-term directive. From the use docs, you find that use Module is exactly equivalent to

     BEGIN { require Module; import Module LIST; }
[download]