in reply to Re^2: stuck with WWW::Mechanize drop down list
in thread stuck with WWW::Mechanize drop down list

Spazm, thanks much, especially for the explanations!

Question. If mech-dump doesn't output content of drop down lists, do I always need to look at the page source and, if so, then add the selection as a 'field' entry?

  • Comment on Re^3: stuck with WWW::Mechanize drop down list

Replies are listed 'Best First'.
Re^4: stuck with WWW::Mechanize drop down list
by spazm (Monk) on Jun 02, 2012 at 06:09 UTC
    I was just about to suggest mech-dump, good that you are already using it!

    Mechanize will only return form elements that are within <form></form> elements.

    The "All" dropdown is not within a set of form tags, it directly triggers javascript to reload the page. In cases like this you just have to figure out what the script is doing and duplicate. Possibly just by inspecting the request URL submitted by the browser.

    This is an area where scraping pages becomes tedious and tricky.

      Thanks again!