in reply to Re^2: perl ST sort performance issue for large file?
in thread perl ST sort performance issue for large file?
open my $fh, '-|', 'sort', $filename or die; chomp(my $line = <$fh>); my ($prev_key, $prev_value) = split /,,/, $line; while (<$fh>) { chomp; my ($key, $value) = split /,,/; if ($prev_key eq $key) { $prev_value .= $value; } else { print "$prev_key,,$prev_value\n"; ($prev_key, $prev_value) = ($key, $value); } } print "$prev_key,,$prev_value\n";
Read the manual page for your OS sort utility in order to find out how to optimize its usage.
Or you could also use Sort::External.
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^4: perl ST sort performance issue for large file?
by rkshyam (Acolyte) on Apr 04, 2012 at 10:04 UTC | |
by salva (Canon) on Apr 06, 2012 at 10:42 UTC |