http://qs1969.pair.com?node_id=127903


in reply to Remove duplicate data from text file

  1. Read the file into an array
  2. Create a hash whose keys are the values in the array
  3. Create an array from the keys of the hash
  4. Print the array out to a file
The details are left as an exercise for the reader.

------
We are the carpenters and bricklayers of the Information Age.

Don't go borrowing trouble. For programmers, this means Worry only about what you need to implement.

  • Comment on Re: Remove duplicate data from text file

Replies are listed 'Best First'.
Code
by ggoebel (Sexton) on Nov 28, 2001 at 01:31 UTC 
    my $filename = ...;
local $/;
open IN, $filename;
$text = <IN>;
@words{split /\s+/, $text} = undef;
@words = keys %words;

    [download]
[reply]
[d/l]

In Section Seekers of Perl Wisdom