You may possibly want to create a "bundle", which is a fake package that says "I have no code of my own, just dependencies". This makes it simple to install a whole bunch od stuff at once. Here's an example of how to make a CPAN bundle.
Comment on Re: Entire project on CPAN -- including all modules