in reply to Writing a news retrieval application.

LWP or WWW::Mechanize should work just fine for your scraping needs, but here's a hint -

Let one of the HTML:: modules do your parsing for you. You'll be glad you did after your scraped site(s) go through a few layout changes.

  • Comment on Re: Writing a news retrieval application.