in reply to Re: Out of Memory when generating large matrix
in thread Out of Memory when generating large matrix

first concatenate the contents of all 197 files into a single file, then to sort that file

In other words, you're unfamiliar with merge sort.

Hardly surprising.

  • Comment on Re^2: Out of Memory when generating large matrix

Replies are listed 'Best First'.
Re^3: Out of Memory when generating large matrix
by Anonymous Monk on Mar 06, 2018 at 02:59 UTC
    Actually, this is a perfectly-boring statistical analysis requirement. The "R" programming language would consider it to be nothing more than an aperitif.

      Sounds neat; and trivial. Let's see the code!

Re^3: Out of Memory when generating large matrix
by Anonymous Monk on Mar 06, 2018 at 13:19 UTC

    Are you implying that merge sort can somehow work better when fed with separate (unsorted) inputs instead of one (unsorted) input?

    Now I wonder, who's the one unfamiliar with merge sort?

      > instead of one (unsorted) input?

      The merging doesn't happen at zero cost and you need to calculate the total.

      Cheers Rolf
      (addicted to the Perl Programming Language and ☆☆☆☆ :)
      Wikisyntax for the Monastery