This looks like a job for a database.

I'd recommend using something simple, like Sqlite, unless you are already familiar with, and have easy access to something bigger/better.

Just load the data into a table, and let SQL do the aggregating for you.