Not a direct answer to your question, but when working with Debian-derived distributions (such as Ubuntu) I find it is always a good idea to use dh-make-perl for installing CPAN packages not provided by the distribution itself. This will allow you to manage the installed modules with the standard Debian package management software (i.e. apt-get,dpkg,aptitude etc.) and even allow proper (albeit slightly painful) dependency management.

More pertinent to the question you ask, you could always become a Debian package maintainer and as such add the modules you're interested in to the Debian system. You'll be required to maintain those packages down the road, and the process of registering is slightly and unavoidably convoluted (I think. Haven't tried it in practice though I intend to, much for similar reasons you give here) but it's a perfect example of scratching one's own itch and thereby benefitting the community.