Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Re^8: Script exponentially slower as number of files to process increases

by xnous (Sexton)
on Jan 30, 2023 at 22:01 UTC ( #11150044=note: print w/replies, xml ) Need Help??


in reply to Re^7: Script exponentially slower as number of files to process increases
in thread Script exponentially slower as number of files to process increases

Ran some more tests, your latest mceiter2.pl script is consistently faster (albeit by a small margin) than fork.pl, however the run time includes the output file merging which is a measurable gain.
  • Comment on Re^8: Script exponentially slower as number of files to process increases

Replies are listed 'Best First'.
Re^9: Script exponentially slower as number of files to process increases
by marioroy (Parson) on Jan 30, 2023 at 22:39 UTC

    So nice of you to write back. That script you linked to is quite efficient, considering it factors out entirely the manager process having to merge (now handled by the workers, cooperatively).

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11150044]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others rifling through the Monastery: (2)
As of 2023-03-31 04:21 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Which type of climate do you prefer to live in?






    Results (74 votes). Check out past polls.

    Notices?