I'm attempting to fetch data from a web page using get. The webpage in question allows people to make only 10 views of a page per day, but when I attempt to fetch the page using get, i recieve a message informing me that all my views are used up for today, despite the fact that this was my first attempt at viewing the page. I'm guessing the problem lies with cookies but this problem is out of my league. Can anyone suggest how I might approch solving this problem. I'm guessing I could establish the http transfer between IE6(my browser - which does allow me to view 10 times) and the server,and then replicate this transfer using perl....is it possible to view the http tranfer of a browser?
thanks barry.

In reply to Fetching web pages using by Baz

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.