Thanks for your replies.

After a little brainstorming I decided to try building the cache in '/dev/shm' and then move it to harddisk once it was complete. This had the ever so pleasing affect of reducing the build time from 15minutes to 15 seconds! It also reduced the size of the built out cache for some reason. Took it from ~70MB to ~38MB?! I Can't even explain that but I'll take it.

Anyway, I thought I would post this here for posterity in case anyone else needs this optimization in the future or if anyone would like to further discuss this method.

In reply to Re: Build a BDB cache quicklier by bennymack
in thread Build a BDB cache quicklier by bennymack

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.