in reply to Removing Duplicate Lines from a File

uniq just removes contriguous duplicated lines. The two lines

B1 name;B1 Bmk;B1 host;B1 arch;B1 mem;B1 dvr;B1 arw;

won't be removed by it. Instead, use DamnDirtyApe's one-liner, that's the full program that does what you need! You don't need to incorporate anything else

Ciao!
--bronto

# Another Perl edition of a song:
# The End, by The Beatles
END {
  $you->take($love) eq $you->made($love) ;
}

Replies are listed 'Best First'.
Re: Re: Removing Duplicate Lines from a File
by softworkz (Monk) on Jul 18, 2002 at 14:59 UTC
    How about this hack? This way it still maintains it's some what sorted order. Tested on Win32
    #!/usr/bin/perl -w
use strict;

my (@array, %hash);
while (<DATA>) {
    push (@array, $_) unless (defined($hash{$_}));
    $hash{$_} = 1;
}

print join("", @array);

__DATA__
B1 name;B1 Bmk;B1 host;B1 arch;B1 mem;B1 dvr;B1 arw;
SomeName;Blondie;server15;unix;1;1;32
SomeName;Blondie;server15;unix;2;2;43
SomeName;Blondie;server15;unix;3;3;54
SomeName;Blondie;server15;unix;4;4;65:
B1 name;B1 Bmk;B1 host;B1 arch;B1 mem;B1 dvr;B1 arw;
SomeName;Blondie;server12;unix;1;5;76
SomeName;Blondie;server12;unix;2;6;87
SomeName;Blondie;server12;unix;3;7;89
SomeName;Blondie;server12;unix;4;8;09;

    [download]
[reply]
[d/l]

In Section Seekers of Perl Wisdom