in reply to Re^2: Using fork for reading and processing a large file in ActiveState perl
in thread Using fork for reading and processing a large file in ActiveState perl
I did, no one mentioned to him how to bring in his huge file, and effectively split it, in order to hand them off to his threads for the parallel-processing. The OP asked I am reading and processing a huge file and recording results to another file which takes hundreds of hours. I want to run this task in multithreads..
How is it wrong to show how to get his input file split into bite sized chunks for his threads? I question whether you understand what needs to be done in an actual program. Maybe you didn't actually look at the link I provided? I showed him the various ways to achieve the first step needed for his code. See How to break up a long running process for some parallel processing usage.
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^4: Using fork for reading and processing a large file in ActiveState perl
by Anonymous Monk on Feb 25, 2010 at 17:16 UTC | |
by zentara (Cardinal) on Aug 02, 2010 at 17:38 UTC |