Update: The below code has two bugs in it. Don't use it. Twas a joke.

If I were tempted to deal with a mailing list like you describe I'd use this program to clean it up real quick. Then I could go on to other things.

This is faster than the other suggestions you've gotten so far, well for almost every input file. It's especially efficient on larger files, note the not very subtle tricks used to increase speed. Certainly you don't have to go to shell to handle this.

This is probably not quite as good as what Chip might come up with though. 

#!/usr/bin/perl -w
use strict;

my $file = "rawlistfile";
my @eadds;

open INPUT, "+>$file" or die "Can't open $file for reading!";

my @eadds = <INPUT>;

foreach ( @eadds) { $_ = lc }
my $prev;
@eadds = sort @eadds;
my $cur = $eadds[0];
my $i = 0;
while (  $cur le $eadds[-1] ) {
    print "$prev\n" if $prev ne $cur and $prev;
    $prev = $curr;
    $curr = $eadds[++$i];
}

[download]

In reply to Eliminating addresses in bulk by rir
in thread Not case sensitive hash? by vxp

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.