If I understand you correctly, cpan is setting the PERL5LIB variable and thus overriding your pre-existing PERLLIB?
A bug report sound better than avoiding PERLLIB because of badly behaving programs :)
Comment on Re: PERLLIB vs PERL5LIB: not quite the same