If the content lends itself to be organized via columns and records, would it be more beneficial to convert this data to a database to do the tasks required? This could save loading the entire content into memory to process it. Secondly, you could perform multiple tasks via DBI.

Sincerely,