in reply to Parse a tar.gz file without unzipping and uncompressing unzipping?

Did you look at Archive::Extract? At least this saves you the file IO.

fnord

  • Comment on Re: Parse a tar.gz file without unzipping and uncompressing unzipping?

Replies are listed 'Best First'.
Re^2: Parse a tar.gz file without unzipping and uncompressing unzipping?
by rizzy (Sexton) on Dec 03, 2010 at 21:18 UTC
    Thanks. That's what I'm currently doing. It's manageable right now, but I figured I'd check to see if it could be further improved.
      From your post, it seemed like you were unpacking into a filesystem. Do the majority of the files you parse each time you run the program change? If not, you could use something like like KinoSearch to allow you to quickly search files that have not changed.

      fnord

        Illuminatus, I WAS initially using Archive::Extract, but had to switch for a couple of reasons. I am on windows (because I can't convince the unix admin to allow me to store these files on the server) and since there is no bin/tar for windows, I have to use perl to do the unzipping which requires system memory. So much memory is required, that I get an "out of memory" error when extracting.

        Anyway, the files are all different in each archive.