By using zcat you can set up a pipeline to uncompress and extract the files from the archive as a stream without using temporary files or needing to hold everything in RAM.

On Linux the code looks like this:

#!/usr/bin/perl

use strict;
use warnings;

my $file = shift;

my $pipecmd = "zcat $file | tar  -O -xf -"; # -O, extract files to sta
+ndard output

open(my $PIPEIN, '-|', $pipecmd) or die "Opening pipe [$pipecmd]: $!\n
+";

while ( my $line = <$PIPEIN> )
{
    chomp $line;
    print "$line\n"; # do parsing here
}

[download]

A Windows version of gzip is available from The gzip home page. I'm not sure if the Win version includes zcat.

You'll need a Windows tar as well. I'm not sure if the pipe command will work in Windows.

This may need better handing of file not found and other errors from the pipe command, but it should get you started.

In reply to Re^2: Parse a tar.gz file without unzipping and uncompressing unzipping? by tod222
in thread Parse a tar.gz file without unzipping and uncompressing unzipping? by rizzy

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.