in reply to sorting large files

There are several modules on CPAN allowing you to sort data on disk as Sort::External or Sort::Key::Merger.

Replies are listed 'Best First'.
Re^2: sorting large files
by polar315 (Initiate) on Dec 30, 2005 at 00:44 UTC
    Tried the file::sort and it consumes a huge amount of memory even on my 100K test file. I was previously using a windows command line sort that worked well but, since I started adding the date to the report names a bit of a pain. Saw the comment regarding the DB. We do that now but, this is for quick and dirty daily reports. Mostly throw aways but, used occasionally. Daily logs run around 20 Gig and just parse out for specific activity for closer examination.

    PERL does great for creating the daily logs.

    Looking to see how to kick off a command line.But, will need to have the file name in it..that is the dome scratcher part.

    Thanks for all the quick replies.