http://qs1969.pair.com?node_id=11149985


in reply to Re^4: Script exponentially slower as number of files to process increases
in thread Script exponentially slower as number of files to process increases

Certainly, there's an anomaly. Do you know what is causing the beautiful script to suddenly leap from 110 seconds down to 50 seconds? Unfortunately, half of the workers exit due to open file error. They go unnoticed due to no warning messages.

Applying the changes here may enlighten you as to why. Another verification is running ls -l data.dat. Is the file size smaller than expected?