in reply to Efficient Way to Parse a Large Log File with a Large Regex

Process the file once, saving the offset into the file that you finished at. Then seek to that position next time and process from there to the end of the file and store the new end of file position.

This should save you a lot of redundant processing.
  • Comment on Re: Efficient Way to Parse a Large Log File with a Large Regex

In Section Seekers of Perl Wisdom