We all know that TIMTOWTDY, but do all the ways have to have something to do with Perl?

If the order of the addresses is irrelevant, and assuming that the file consists of one address per line, I'd use sort (1).

sort -u -o address_file.txt address_file.txt

[download]

When the only tool one has at hand is a hammer,
one tends to believe every problem is a nail.
And I confess that this saying applies to me all too often ;-)

--bwana147

Update: I hadn't seen perlplexer's contribution. It might be interesting to note that uniq works only if duplicate lines follow each other. It won't work if duplicates are scattered across the file. In such a case, you'll have to sort the file first, and pipe the sorted output into uniq, which is exactly what sort -u does.

My € 0.02

In reply to Re: Files by bwana147
in thread Removing duplicate lines from files (was 'Files') by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.