in reply to How to quickly parse a huge web log file?

9 million lines/second doesn't seem too bad to me. But you could save almost all of the memory, by just printing the matching lines as you find them, rather than pushing them to an array and printing them all at the end.


Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
"Too many [] have been sedated by an oppressive environment of political correctness and risk aversion."
  • Comment on Re: How to quickly parse a huge web log file?