in reply to Giant Tie'd data structures

DB_File, aka Berkeley DB, is commonly used to store terabytes of data. I think you're twiddling the wrong parameter here. Berkeley DB can handle a few GBs without breaking a sweat.