in reply to Re^3: How to split file for threading?
in thread How to split file for threading?

i see, but why is that better? Are they not equivalent? one slurps first then processes whereas while reads and process one at a time?

Replies are listed 'Best First'.
Re^5: How to split file for threading?
by BrowserUk (Patriarch) on Jun 23, 2015 at 16:01 UTC
    one slurps first

    How much memory do you have? And how big is the file?


    With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
    I'm with torvalds on this Agile (and TDD) debunked I told'em LLVM was the way to go. But did they listen!
      i run it on the grid so i designate the memory. files are usually 20GB
      Not too big for Hadoop to handle.