i'm not sure how well this fits into cufp, 'cause it some respects it's standard swiss army chainsaw-type perl, but as i suspect that there are those here who might be interested in this on a couple of levels here it is.

several months ago, after i set up a squid cache at my work location i got to looking around and realized that while there are a number of scripts that perform various kinds of queries against the squid access.log, there are few tools to enable the kind of longer-term analysis that could provide input for tuning the cache. so i wrote a little script for parsing the log and inserting the results into a mysql table. at that point i realized that the elements in the table are not generally well-suited for statistical analyses, so i started thinking about proxy variables and other transforms. ultimately, i launched into writing a script that pulled records from the mysql table, flagged certain type of dates and did a couple of other things, and inserted the results in a postgresql table. the scripts i use, the sql statements used to create the tables, and a couple of pages of general information can be found here. (sorry about the ads ... it's free, right?)

this is obviously a work in progress, but anyone who wants to use any part of it is welcome to, subject to the standard disclaimers.

In reply to squid cache logs analysis by ralphie

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.