in reply to Removing duplicate lines from a file

If the data file exists before your program runs, I'd use the *nix sort -u command first. Then your program could process the unique records present in the file.
  • Comment on Re: Removing duplicate lines from a file