Here's an example Makefile.PL using Module::Install::Bundle that won't require the use of cpan in your package:

use inc::Module::Install;

name         'Catalyst-App';
author       'Author <author@cpan.com>';
perl_version '5.005';
all_from     'lib/Catalyst/App.pm';

requires  'Catalyst::Runtime' => '5.80032';
requires  'Catalyst::Devel'   => '1.33';

test_requires = 'Test::More'          => '0.98';
test_requires = 'Test::Pod"           => '1.45';
test_requires = 'Test::Pod::Coverage' => '1.08';

auto_bundle_deps;

WriteAll;
[download]

You'll need to enter your own error-checking methods.