If this is a write once / read many situation, I'd recommend Berkeley DBs; BerkeleyDB, DB_File. It would be mildly quite slow to build but after that look-ups are, as a coworker used to say, greasy-fast.