in reply to Fast/Efficient Sort for Large Files

Everyone else has offered helpful suggestions so I'll ask the big question.

How is it that you have 100,000,000 records that need to be sorted, and yet it isn't in a database?

  • Comment on Re: Fast/Efficient Sort for Large Files

Replies are listed 'Best First'.
Re: Re: Fast/Efficient Sort for Large Files
by waswas-fng (Curate) on Dec 19, 2002 at 22:34 UTC
    I suppose there are many reasons why you could have 100mil records in a flat file, as a sysadmin some that come to mind are log files for busy web servers, name servers, terse logging for samba. Also there are programs in the wild (beleave it or not) that we don't have the source for that have hardcoded outputs. =) oo oo and those pesky 10 year old propriatary mainframe apps with there gooffy output. /me wishes he could wave his magic wand have all of this data magically be in relational DBs -- ACK! but then what would we really need a Practical Extraction and Report Language for? =)

    -Waswas
[reply]
      For DBI? ;)

      Makeshifts last the longest.

[reply]
        touche =)

        -Waswas
[reply]

In Section Seekers of Perl Wisdom