in reply to Re: Multi-thread combining the results together
in thread Multi-thread combining the results together
My single threaded code uses a hash for the output, but I don't need to do that. Each thread can push a ref to Array (a row) onto a common output queue and I can deal with that after everybody is finished. Converting 80K rows to a hash or sorting this is a "no brainer" compared with the time it takes to run the regex.
I wrote the build_regex() function back in 2007 and I'm at the point where what was easily fast enough a decade ago no longer is. I will be rethinking the algorithm, but if I can "juice this baby up by a factor of 3-4", that will give me enough time to ponder a new approach to the problem.
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^3: Multi-thread combining the results together
by bliako (Abbot) on Jul 25, 2019 at 11:18 UTC |