I have a Perl script that runs on Unix & Windows and it packages large data orders. It needs to be able to create a Tar archive of potentially hundreds of files that will add up to 1 GB or more in total size and it needs to do this without loading the files into system memory.
Initially, I was using Archive::Tar::Streamed, which worked well for small orders, but I eventually ran into Perl's "Out of memory!" message. The CPAN page says, "Tar archives, non memory resident", but I wish I had seen this node ( http://www.perlmonks.org/?node_id=418781 ), first. Now, I'm in a tight spot and I need a solution fast. Can anyone suggest an option?
Many thanks,