Hi all,

I have a quick question about the best way to cache a bunch of data for a program I'm making. The data will be cached is roughly 15 KB per entry (a web-page). I am not sure yet how long it will need to be cached. Maybe one day, maybe one month. There will be at least 1000 entries per day.

What I am wondering, is if it will be faster in the long-run to store the data in MySql table and query it each time I need the data with DBI, or in regular files on the server, and slurp them in each time I need the data. Which takes longer for perl? And what about checking ffor the existence of a cached file? Is it quicker to check for a file with -e or to query the database only to find it empty? What if there are x number of users searching at once?

I have no idea why I think this, but for some reason it seems that MySql would be faster unless I find i have to cache the data longer than I expected and the table just gets huge... in that case would it be faster to store it all in files, or would proper indexing on the tables be fine?

In reply to quickest way to access cached data? by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.