in reply to Re^2: Large file, multi dimensional hash - out of memory
in thread Large file, multi dimensional hash - out of memory
As the input file is sorted, uniq infile > outfile ought to do the job very quickly.
If for some reason you don't have the uniq command available, try
#! perl -w use strict; my $last = <>; while( <> ) { print $last if $_ ne $last; $last = $_; } __END__ thisscript infile > outfile
|
|---|