in reply to Re^3: hang caused by read / readline?
in thread hang caused by read / readline?

(Sorry if this is a repeat, but my last reply doesn't appear to be visible in the main node view.) How could that first part of your code be incorporated into an existing script rather than being issued from the command line? I would like to perform the s/\0+//g substitution on the input file and then save it before moving on to the rest of the script.

Replies are listed 'Best First'.
Re^5: hang caused by read / readline?
by ikegami (Patriarch) on Sep 04, 2009 at 18:24 UTC 
    my $buf = '';
local $/ = \4096;
while (<>) {
    s/\0+//g;
    $buf .= $_;
    process_line("$1") while $buf =~ s/^(.*)\n//;
}
process_line($buf) if length($buf);

    [download]
[reply]
[d/l]
      Thanks! I was able to get some Chatterbox help, also. I noticed that your first example used a chunk size of 65536, but this example is using a chunk size of 4096. I used 65536 in my script, and it ran very quickly. Is there a reason to use something other than 65536 for $/ ? What are the considerations?
[reply]

        Benchmark to see what works best for your data. I made up both numbers. (Perl does 4k reads internally.)

[reply]

In Section Seekers of Perl Wisdom