Often this will happen if you go to install a module and the make test fails due to missing dependencies (or the dependencies of dependencies) which are not indicated in the Makefile.PL - even if, in the same CPAN shell session, you install succesfully the missing dependencies you will get this message. I have never investigated further but exiting from the CPAN shell and restarting it fixes the problem.

/J\