The Berkeley DB seems to meet you specification perfectly it's not a straight forward DB by any means however, check out BerkeleyDB, very fast, key / value pairs, db_dump and db_load for bulk loading, full ACID transactions etc... however you would have to host the DB environment on the same server, it doesn't support network access as it's an embedded database. The hash structure would suit your needs. It does fail on the compact storage aspect as a DB Hash is larger than the original data, but that's the trade off for fast access.

As suggested previously an LDAP server (Net::LDAP) might also suit your needs.

print "Good ",qw(night morning afternoon evening)[(localtime)[2]/6]," fellow monks."

In reply to Re: fast disk db with bulk insert, fast read access, compact storage by Utilitarian
in thread fast disk db with bulk insert, fast read access, compact storage by iaw4

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.