in reply to Re: finding duplicate data
in thread finding duplicate data
to find unique data (though the perl solution would be doing less work, and would not scramble the line order).sort -u filename
To list the duplicate entries only once,
perl -ne 'print if $h{$_}++ == 1' filename
|
|---|