I don't know what you're trying to do with this task, and I know it doesn't help you solve the problem you're having ...

... but are you aware that there's a robots.txt on the site, specifically requesting that you not automate access to its contents?

(yes, I know, there are many differing interpretations of what types of programs should use the robots.txt -- for instance, if you manually started the process, but it just grabbed the pages to present them as one page for you, that's likely different than trying to retrieve the pages for pre-caching or a search engine spider)

Update: ikegami is right -- my browser put its insertion bar at the end, which I mistook for a /. (bah ... time to get my eyes checked again). They specifically allow robot access. Feel free to down vote my oversight.

In reply to Re: Win32::IE::Mechanize not getting correct content by jhourcle
in thread Win32::IE::Mechanize not getting correct content by cormanaz

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.