LWP has all the tools you need to check the validity of an URL. Commonly, one tries a HEAD request. If that fails try a GET, since some sides deny all HEAD requests.

It's a good idea to contact the webmaster of each site. It is a courtesy, and you can get detailed information about their camera schedule and http practices.

Before you dig in to write code, give some thought to your design. Do you really need to check with each page request? HTTP requests can take a while, do you need to fork off these requests to keep your main script awake? Or the client from timing out?

Some effort spent on realistic study of time and resource needs will really pay off, I think.

After Compline,
Zaxo


In reply to Re: Testing URL existence by Zaxo
in thread [untitled node, ID 176516] by Samn

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.