Thanks for the tip. I used it.

Matt Trout from DBIC suggested rm -f `perldoc -l Module::Signature` as a nice way to do that.

Also, when rerunning cpanp...

Could not find or check module 'Module::Signature' [THIS MAY BE A PROB
+LEM!] at /usr/lib/perl5/site_perl/5.8.8/CPANPLUS/Dist.pm line 430
Running [/usr/bin/perl -MCPANPLUS::Internals::Utils::Autoflush Makefil
+e.PL ]...
Looking for GNU Privacy Guard (gpg), a cryptographic signature tool...
GnuPG found (/usr/bin/gpg).
Import PAUSE and author keys to GnuPG? [y] n
[download]

The default was yes, I answered no.