Well, you could kick out all the documentation and probably most modules. The list below is probably a good starting list of modules you'll need:

perl -Mstrict -Mwarnings -MFile::Copy -mFile::Path -e'print "$_\n" for
+ sort keys %INC'
Carp.pm
Config.pm
Exporter.pm
File/Basename.pm
File/Copy.pm
File/Path.pm
File/Spec.pm
File/Spec/Unix.pm
re.pm
strict.pm
vars.pm
warnings.pm
warnings/register.pm
[download]

Also, as far as I know the "architecture" is the architecture your perl is build for, not the arch it was build on. That probably means you can't reliably run i686 perl on i586 at all. You might want to build a 486 perl if you're concerned about portability.