You're right, I misread the problem. I was thinking of repeated lines, not duplicates.
In reply to Re^3: duplicate lines by mikeraz in thread duplicate lines by Anonymous Monk