it depends ... to a certain degree what you want to do is configuration management and app deployment. It will be up to you to decide if what you are doing is just simple maintenance scripting or maybe its time to formalize your approach.

A build.pl (Module::Build) would give you app deployment and manage the deps, but you may combine using some Configuration Management (CM) ... I have used puppet with great success and would highly recommend investigating using it ... you can easily control every aspect of a machine ... I use debian packages for most of the perl stuff these days, but it also has cpan integration and *everything else*.