This has become my standard recommendation: try WWW::Mechanize, great for scraping (and testing). And there were also some discussions in To mechanize WWW::Mechanize: a scraping language?