I agree with trippledubs that perlbrew is the way to go. When you use perlbrew, you can install modules as a normal user. It will allow you to avoid using sudo, and avoid perturbing the system perl.

If you install a perl with perlbrew, you may want to consider using cpanminus as an alternative to the cpan application. Cpanminus works very well with perlbrew. See the Installing to local perl (perlbrew, plenv etc.) section of the cpanminus documentation.