in reply to Sorting a large file

In the vein of considering tools for jobs...
Is Perl actually the right job for doing this? I know that:
sort <file> | uniq
gives a pretty good sort speed.
The logs I deal with here are hundreds of megs long (or several gigs in many cases), and I have to deal with an awful lot of them.
It works fine for me.. I know it's not Perl, but, it's a tool that does the job adequately for a lot of things..

Just a thought,

Malk.

Update:
For a set of windows tools (only just noticed you were using that), try this.
  • Comment on Re: Sorting a large file (non-perl solution)

Replies are listed 'Best First'.
Re: Re: Sorting a large file (non-perl solution)
by c-era (Curate) on Feb 21, 2001 at 19:00 UTC
    Once again, it the windows thing, but if you know of a good sort for windows, that could be another option. The development tools we have are java and perl. The java guys couldn't get a decent sort to work under java, so they came to me to do it in perl.

    Update: Thanks for the link, I can get away with installing a couple of small programs, and it only uses a couple MB of memory.

[reply]
      You can still use Malkavian's solution on Windows. Check out Cygwin or install it. OTOH it'll give you a lot more than just a sort program.
[reply]
        Installing cygwin on the computer won't make it past management.
[reply]

In Section Seekers of Perl Wisdom