The answer depends on whether you want to work with the whole of a website or just part of it. It also depends on your network setup.

The easiest solution would be to buy more data-transfer from your ISP or choose and ISP that didn't impose such limits.

A fairly easy solution would be to access the Internet through a proxy server which was configured to cache the files that had previously been accessed. This works very well if a number of the employees in your company access the same pages.

You could also mirror the whole or part of the site and maintain a local copy. The initial download will take up a lot of your data transfer limit but (if the software is any good) the update process should only validate the cached files and not download unchanged ones. Check out wget for a start.

Downloading a discrete set of pages should be easy enough with a script. You will have to handle the login and then work through the target pages, following links, downloading target pages and changing the links so that they refer to local files. Look at the section on mirroring in the LWP documentation.


In reply to Re: Auto Login to Websites by inman
in thread Auto Login to Websites by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.