Just to add a few more points, that sort command above automaticaly does a split sort merge sort, it is still single threaded but I dont know that you will be able to get much faster by forking or threading it in perl. Also unlike the posts above I would say do _NOT_ use the mem limiter flag on the sort command as it makes sort way slower. Solaris's sort is smart enough to use as much memory as it can to make the sort faster -- and not try to do _everything_ in memory unless it can. Overall Solairs sort has proved to be very fast compaired to perl's sort except for the occasions where you must do >5 or 6 compound compairs row or do inline mods to the data.

-Waswas

In reply to Re: Re: Fast/Efficient Sort for Large Files by waswas-fng
in thread Fast/Efficient Sort for Large Files by mjmaresca

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.