One obvious solution is to use some kind of tied hash where the data would actually be on disk, not in your RAM, impressive as it is...