Tried the file::sort and it consumes a huge amount of memory even on my 100K test file. I was previously using a windows command line sort that worked well but, since I started adding the date to the report names a bit of a pain. Saw the comment regarding the DB. We do that now but, this is for quick and dirty daily reports. Mostly throw aways but, used occasionally. Daily logs run around 20 Gig and just parse out for specific activity for closer examination.

PERL does great for creating the daily logs.

Looking to see how to kick off a command line.But, will need to have the file name in it..that is the dome scratcher part.

Thanks for all the quick replies.

In reply to Re^2: sorting large files by polar315
in thread sorting large files by polar315

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.