Krang has a nice system of managing packages, which includes being able to build the entire application from scratch. I use my Makefile.PL to document the dependencies, and also download a copy of that CPAN package to a src/ directory in my application. Because it's good to have it there if a few years down the road that package for whatever reason isn't on CPAN or BackPAN.