in reply to Re: Best Practices for Uncompressing/Recompressing Files?
in thread Best Practices for Uncompressing/Recompressing Files?

Most of this I agree on, exept where to split the poccess boundy, I would make the whole task seperate forked out up to 4 at a time in parrallel. His CPU throttleing is happening at the time of compress and decompress. As far as storing the uncompressed files in ram, I think that the ram is more useful in this case for the zlib/gzip operation which tends to slow down a lot when starved. Of course who knows about the disk IO =) he could have a just array of JBOD striped on multiple interfaces =)...

-Waswas
  • Comment on Re: Re: Best Practices for Uncompressing/Recompressing Files?

Replies are listed 'Best First'.
Re: Re: Re: Best Practices for Uncompressing/Recompressing Files?
by biosysadmin (Deacon) on Sep 15, 2003 at 05:37 UTC
    Just felt like adding this after re-reading the thread: Sorry about not being specific about the setup that I'm working with, but I actually have 2 separate drives:
    • A SCSI RAID array which is the source and eventual destination of the files
    • A single SCSI drive that holds the files temporarily.
    So, the files start on drive 1, go to drive 2, and are reformatted back to drive 1.