in reply to Re^4: Script exponentially slower as number of files to process increases
in thread Script exponentially slower as number of files to process increases
Certainly, there's an anomaly. Do you know what is causing the beautiful script to suddenly leap from 110 seconds down to 50 seconds? Unfortunately, half of the workers exit due to open file error. They go unnoticed due to no warning messages.
Applying the changes here may enlighten you as to why. Another verification is running ls -l data.dat. Is the file size smaller than expected?
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^6: Script exponentially slower as number of files to process increases
by cavac (Parson) on Feb 02, 2023 at 13:08 UTC | |
Re^6: Script exponentially slower as number of files to process increases
by kikuchiyo (Hermit) on Jan 28, 2023 at 17:44 UTC | |
by marioroy (Prior) on Jan 28, 2023 at 18:38 UTC | |
by xnous (Sexton) on Jan 30, 2023 at 22:01 UTC | |
by marioroy (Prior) on Jan 30, 2023 at 22:39 UTC | |
by xnous (Sexton) on Jan 28, 2023 at 17:55 UTC | |
Re^6: Script exponentially slower as number of files to process increases
by xnous (Sexton) on Jan 28, 2023 at 17:51 UTC |
In Section
Seekers of Perl Wisdom