somehow nobody above mentioned the CPAN module that is used to install most packages direclty from CPAN, thought I'd add it here.

Usually you invoke the CPAN shell as:

perl -MCPAN -e shell
[download]

then simply type:

install Crypt::OpenPGP
[download]

In this particular case, it has many dependencies, it will ask you whether you want to install those, just say yes.