A more efficient way to do this is to "rotate" the log (rename the log file), before processing it, and then store the preprocessed results in a file.

When reporting results, you can read the previous results file, such that you only have to process the small amount of new data that have accumulated since the last analysis.