Unless I mis-understand, LWP has nothing to do with arbitrary URL fetching of it's own accord. To impose a caching mechanism on it implies permanent storage of something, somewhere to use it. I'm sure I wouldn't be using it for much of anything if I had to provision some permanent file/folder/database just to use it.

My knee jerk theory is that 99.99% of the traffic problem is caused by web bots and spiders that simply strip any URL they find out of the page and keep on trucking. I'll even go so far as to say W3C did it to themselves by specifying a "http://" URL in the first place. I really don't think they've got any choice now but to live with the consequences.

On the other hand if they can embed some google adds in those DTDs they're probably sitting on a gold mine!

In reply to Re: HTTP Caching (was: WC3, DTD's and CGI.pm) by ruzam
in thread WC3, DTD's and CGI.pm by Mr_Micawber

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.