Update: archaeological note: The OP's previous questions are Removing duplicates in large files and End of the Time Out Tireny.

If (as you've said before) your code is crawling or running out of memory sorting only 120000 email addresses, you've got a problem with your code. If you will please show what you've tried instead of just asking again, you will get better answers. (Update: my hypothesis that memory shouldn't be an issue is predicated on the knowledge that this is running on a web server.)

Also, some evidence that you've tried something like some of the solutions proposed would be appreciated. Why don't you give the solutions in Re: Removing duplicates in large files (a hash, or divide-and-conquer) a try (starting with the first and moving down)?

In reply to Re: Thanks again no Time Out No Duplicates by ysth
in thread Thanks again no Time Out No Duplicates by TIURIC

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.