Consider using Berkeley DB, SQLite, or some other database instead of CSV files. Your two dozen CSV files might be replaced with two dozen corresponding tables—or possibly just one table, if the CSV files share a common definition.

Jim