Re: Re: Removing duplicate records in text file

You also need to sort the lines in case the duplicate records are not next to each other.

sort file.txt | uniq > file2.txt
[download]

Also, being a Unix-y solution, you may be leaving Windows users out in the cold unless they have cygwin or something similar installed.

Comment on Re: Re: Removing duplicate records in text file Download Code

Replies are listed 'Best First'.
Re: Re: Re: Removing duplicate records in text file by ctilmes (Vicar) on Aug 03, 2003 at 21:52 UTC
Or, if your sort supports it: `sort -u file.txt > file2.txt` [download]	[reply] [d/l]