If sudo is giving your trouble, stop trying to mess with the system perl, stick with apt-get or whatever your system perl uses :)

What you likely want to do is to install modules in your home directory and let perl know about it through PERL5LIB, see Re^3: Problem in using Web::Scraper, coming from HTML::TreeBuilder::XPath (cpanm PERL5LIB) and Re: Why does PERL5LIB need to be so verbose? ( INSTALL_BASE the local::lib way) and Re: cpanm --sudo installs to /root/perl5 instead of /usr