Module::ScanDeps will provide you a list of dependencies of your app.pl. Copy them from your Perl installation to lib/ or install a fresh copy from CPAN, specifying PERL_LOCAL_LIB_ROOT, PERL_MB_OPT, and PERL_MM_OPT accordingly. perl.exe will probably need its perl5xx.dll alongside.

You can use Perl embedding features to build your own exe (with icon, manifest and everything) which launches the Perl interpreter, like this.