I've used sort on files in the GB range with millions of lines of text. Note: one good sanity check, in addition to checking for errors from sort, is to make sure the sorted file is the same size as the input file. Update: Took out references to "GNU" since I'm not sure I've specifically used it on files that large (though it might work fine).
In reply to Re: Efficiently parsing a large file
by bluto
in thread Efficiently parsing a large file
by neilwatson
| For: | Use: | ||
| & | & | ||
| < | < | ||
| > | > | ||
| [ | [ | ||
| ] | ] |