I don't know exactly what you're trying to do, but as you mention:

somewhere on the order of 20 pages on about 200 URLs

It sounds to me like you're just trying to watch pages that you're linking to, and checking to see if they still resolve. if that's the case, you might try some of the specialized scripts that exist for this sort of thing, such as linklint, or search for 'link checker' with your favorite internet search engine.

...

As for other approaches ... if it's static pages, you can use GET but then set a current 'If-Modified-Since'. Otherwise, you can also start retrieving a document, then close the connection. (I don't know of any HTTP clients for Perl that do this ... you'd likely have to use IO::Socket and write your own).

In reply to Re: Check if URL exists by jhourcle
in thread Check if URL exists by sivel

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.