Arrange to have the file rotated, then process the files that have rotated off, putting results into a database. Also, bear in mind that there are many existing programs out there which do this job most-completely, fun though it may seem to write yet another one. There must be a hundred already.