See thread keeping connection alive while spending time building a zip file where a similar problem with generating large zip files on the fly was discussed.

Having the zip files already available is the best way to go with this. If that isn't an option, and you can't use one of the other suggestions in that thread, you will have to stream the zip file as it is created to the client.

That means two things:

  1. You need to use HTTP chunked transfer encoding to send the content to the device as you write it. How you get that working will depend on what web setver you are using.
  2. The zip implementation you use needs to support streaming output.

I din't think Archive::Zip supports streaming output. Both the command line zip and IO::Compress::Zip can stream a zip file as it creates it.

Below is a proof of concept code I posted in the other thread that streamed a zip file and chunked it at the same time using IO::Compress::Zip. 

use IO::Compress::Zip qw(:all) ;

select STDOUT;
$| = 1;

my $OUT = \*STDOUT;               

print <<EOM;
Status: 200 OK
Content-Type: application/zip
Transfer-Encoding: chunked

EOM

my @files = qw(/tmp/file1 /tmp/file2) ;
zip [@files] => '-',
        FilterEnvelope => sub         
            { 
                # Chunk the output
                my $length = length($_);
                $_ = sprintf("%x", $length) . "\r\n" . $_ . "\r\n";
                $_ .= "\r\n" unless $length;
                1;
            }
        ;

[download]

One thing missing from your original requirements is the ability to rename the zip file members as you create the zip file. That is a feature that is under development now for IO::Compress::Zip (I'm the author of the module). I can get you an early rlease if you want.

In reply to Re: Creating Zip Archives on the fly by pmqs
in thread Creating Zip Archives on the fly by fulmar2

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.