in reply to How to speed up/multi thread extract from txt files?

Another thing to think about: since you know that you're spending 25 seconds on file IO alone, you might consider reading the file in larger chunks than one line (perhaps 64K chunks). Might shave off a few seconds.
  • Comment on Re: How to speed up/multi thread extract from txt files?