in reply to MCE: Slow IPC between child and gather process in parent

How fast does it run single-threaded?

Do you need to cross-reference the data between files or are their processing unrelated?

  • Comment on Re: MCE: Slow IPC between child and gather process in parent

Replies are listed 'Best First'.
Re^2: MCE: Slow IPC between child and gather process in parent
by learnedbyerror (Monk) on May 02, 2018 at 16:45 UTC

    Please see my update above

    It has been a long time since I ran through all of the data single threaded. My memory is that it took well over an hour.

    No, none of the files are cross-referenced. Each data file is independent of the others

    Thanks, lbe