in reply to article on 'data mining with Perl'

I have used LWP::Simple to get and parse web pages in the past, but I haven't yet learned what tools would be appropriate to access some of the more interesting (to me) data out there. I'm referring to web sites that require login before the data of interest is available. For examples: real-time stock quotes from brokerage accounts, automated retrieval of web-based email, automated retrieval of online banking transactions, etc.

The answer to this is undoubtedly RTFM, but any pointers to particular documentation would be great.

Josh

Replies are listed 'Best First'.
Re: Re: article on 'data mining with Perl'
by Hero Zzyzzx (Curate) on Mar 08, 2002 at 01:05 UTC

    Read lwpcook, which comes with perl 5.6.1, or at the end of a google search. This has examples of various neato things you can do with LWP::UserAgent and it's related friends.

    -Any sufficiently advanced technology is
    indistinguishable from doubletalk.

      Thanks HZ -- I bet that an evening spent with lwpcook and the HTTP RFC will be just the ticket.

      Josh