in reply to Sorting Gigabytes of Strings Without Storing Them

I have a set of strings with upto 2GB lines.

Is that

  1. Individual lines of 2 GB characters?
  2. Or 2GB of data split into lines of ~34 charcters?
  3. Or 2 billion lines each of ~34 characters?

An appropriate solution could be dependant upon the distinction.


Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
"Too many [] have been sedated by an oppressive environment of political correctness and risk aversion."
  • Comment on Re: Sorting Gigabytes of Strings Without Storing Them