in reply to MLDBM for hash > 2GiB?

You should switch from GDBM_File to BerkeleyDB. It supports file sizes of multiple terabytes. Also, use Storable, since it's faster and more compact. There is no need to use a relational database for this -- you just need a more scalable dbm.

Replies are listed 'Best First'.
Re^2: MLDBM for hash > 2GiB?
by gregor-e (Beadle) on Nov 29, 2005 at 17:27 UTC
    I installed BerkeleyDB from CPAN, changed the use to: 
    use MLDBM qw(BerkeleyDB Storable);

    [download]
    and gave it a kick. It moaned: 
    TIEHASH is not a valid BerkeleyDB macro at /usr/lib/perl5/site_perl/5.
+8.5/MLDBM.pm line 143

    [download]
    Is there a way to persuade MLDBM to use BerkeleyDB? (Okay, I've only scanned the friendly manpage for BerkeleyDB briefly. I'll go back and give it a good squint.)
[reply]
[d/l]
[select]
      Try this:

      use MLDBM qw(BerkeleyDB::Btree Storable);

      Also, there is a section on MLDBM in the BerkeleyDB docs.

[reply]
[d/l]
        It's now at 14GiB and counting. That did the trick! Thanks.
[reply]

In Section Seekers of Perl Wisdom