in reply to Best Practices for Uncompressing/Recompressing Files?

Just to make sure the obvious wasn't overlooked; Make sure you are running gzip silently. The overhead created by STDOUT on the zip/unzip process is significant

coreolyn
  • Comment on Re: Best Practices for Uncompressing/Recompressing Files?

Replies are listed 'Best First'.
Re: Re: Best Practices for Uncompressing/Recompressing Files?
by sauoq (Abbot) on Aug 12, 2003 at 01:38 UTC
    Make sure you are running gzip silently. The overhead created by STDOUT on the zip/unzip process is significant

    Uhh . . . huh?

    Even with --verbose, gzip only prints one line for every file it processes. That's hardly what I'd call significant. Especially not in a case like this where each file averages 200M of uncompressed data!

    -sauoq
    "My two cents aren't worth a dime.";
    
Re: Re: Best Practices for Uncompressing/Recompressing Files?
by coreolyn (Parson) on Aug 12, 2003 at 14:49 UTC

    Unfortunatley I don't have time to write a benchmark but can only speak from expirience. On one large tar & zip routine that we run here in production we shaved 15 seconds off the operation just by going silent

    coreolyn