in reply to Getting rid of duplicates
open in,"file" or die "can not open input file\n"; while (<in>){ print if ($_ ne $prev_record); $prev_record = $_; } [download]
Please read disclaimers by all monks that contain the word not.