You may want to look at Perlbrew. It allows you to install your own Perl, and use it instead of system Perl, and install CPAN packages to your heart's content.
Note that there's a limit for perlbrew: For CPAN libraries which are just interfaces to "standard" libraries, like in the case of XML::LibXML which is based on libxml2, and if libxml2 is not available, then there's nothing perlbrew can do for you unless you also take the trouble to compile libxml2.