Re^2: How do I Extract Data From Amazon.com's Website?

If you're dealing with a web interface (i.e. HTML with forms, links, etc instead of "pure" HTTP) you're probably better off using WWW::Mechanize - it's an LWP subclass with lots of specialized methods to search and "click" through web pages/forms.

There are even a few "clones" of WWW::Mechanize that use popular browsers at the back-end so you can deal with javascript and other client-side objects not normally supported by WWW::Mechanize.

"What should it profit a man, if he should win a flame war, yet lose his cool?"

Comment on Re^2: How do I Extract Data From Amazon.com's Website?

Replies are listed 'Best First'.
Re^3: How do I Extract Data From Amazon.com's Website? by erroneousBollock (Curate) on Aug 16, 2007 at 06:58 UTC
Recently, some folks figured out a way to use Mozilla in a mechanize driver without the need for a (visible) X-server. Sounds promising. -David	[reply]