in reply to From bash to perl

I use wget to download the file at the end of the URL (a web page) and write it to a file, then I open the file and read through it with a while loop one line at a time.

Next time, show us some of your code -- it's just better that way.

So you'll start using LWP or LWP::Simple (and I'm not surprised you didn't find them... I still have trouble remembering how these module names relate to their function, let alone what "LWP" actually stands for).

After that, the next thing you'll want to get acquainted with is the more appropriately named HTML::Parser. This will help tremendously in doing a proper job of whatever it is you are trying to do with the web pages that you are downloading -- and you won't even need to store the html data to a file first (though you probably want to do that anyway), because HTML::Parser can work directly on the scalar variable that holds the full content of the page (after LWP assigns the fetched web-page content to that variable). Good luck.

Replies are listed 'Best First'.
Re^2: From bash to perl
by Anonymous Monk on Nov 08, 2006 at 09:35 UTC

    I still have trouble remembering how these module names relate to their function, let alone what "LWP" actually stands for

    LWP stands for libwww-perl, the second word mentioned in the DESCRIPTION section of the LWP manual page.