in reply to Searching Huge files

Use a database. This is exactly what a database is designed to do. Any work you do would simply be replicating what has literally had man-DECADES thrown at it.
  1. Load files into a database. 2M rows and 8M rows are small-ish tables.
  2. Run SQL queries against those tables.
My criteria for good software:
  1. Does it work?
  2. Can someone else come in, make a change, and be reasonably certain no bugs were introduced?

Replies are listed 'Best First'.
Re^2: Searching Huge files
by biomonk (Acolyte) on Jul 09, 2008 at 11:57 UTC

    I thank all of you for your support and quick response, i now feel that i'm not alone in this Perl world.

[reply]

In Section Seekers of Perl Wisdom