in reply to To Automate through a Dynamic Page like that of Twitter, Using www:mechanize:firefox

There are just two steps to do that:

  1. Find out how a human navigates the page
  2. Replicate those steps using WWW::Mechanize::Firefox

You haven't told us where you have problems, so I suggest you start at step one.

  • Comment on Re: To Automate through a Dynamic Page like that of Twitter, Using www:mechanize:firefox

Replies are listed 'Best First'.
Re^2: To Automate through a Dynamic Page like that of Twitter, Using www:mechanize:firefox
by Matt™ (Acolyte) on Sep 21, 2012 at 13:49 UTC

    Thanks Corion. We need to scroll down the page of twitter in-order to get the next set of 20 tweets, Can we replicate the Scroll down process in WWW::Mechanize::Firefox or, is there any alternate way? Thanks in advance.

      There is no direct way with WWW::Mechanize::Firefox. But you can run arbitrary Javascript through it, so you can use that to scroll the page down.

      Personally, I would look at what function gets called to load more information.

      Also, you are certainly aware of the Twitter API and/or Net::Twitter?