in reply to Re^2: Find duplicate lines from the file and write it into new file.
in thread Find duplicate lines from the file and write it into new file.

Yeah, without knowing anything about the input file I was really just brainstorming... In my experience a 4gig file is probably a log file or something and collisions may not matter very much — it really dpeneds on what the filtered output is intended to do.

-Paul

  • Comment on Re^3: Find duplicate lines from the file and write it into new file.

In Section Seekers of Perl Wisdom