That's too much data for an in-memory hash, but you could probably make it work with a dbm file and something like MLDBM.