in reply to fast lookups in files

I have been faced with this problem in the past. What I did was I tied a perl hash on the file system (lookup DBI tie) That way the hash data structure was created on the disk as opposed to memory. Try that! Hanif