If you're using Red Hat or some of its derivates, you can use the amazing cpan2rpm application. I use it in my RHEL environment at work.

Update: On Gentoo, you can also use g-cpan, and create the respective packages for offline install using qpkg.