Re: Seeking through a large gzipped file

PerlIO::via::gzip will probably work as fast as "zcat", but without the need to shell out.

Since it gives you a file handle, "seek" should work.

"I'm fairly sure if they took porn off the Internet, there'd only be one website left, and it'd be called 'Bring Back the Porn!'"
-- Dr. Cox, Scrubs

Comment on Re: Seeking through a large gzipped file

Replies are listed 'Best First'.
Re^2: Seeking through a large gzipped file by Corion (Patriarch) on May 14, 2013 at 17:34 UTC
If you have at least one idle CPU, using `open "zcat $file \|"` will allow you to spread the load across two CPUs, one for the `perl` process and one for the `zcat` process. That way, all the CPU cycles you need for decompressing the data get offloaded from `perl`. This should be at least as fast as using [mod://PerlIO::via::gzip</c> if not faster, as usually transferring the data between processes is fairly fast.	[reply] [d/l] [select]
Re^2: Seeking through a large gzipped file by roysperlarnab (Initiate) on May 14, 2013 at 17:06 UTC
I'll try that, thanks	[reply]