Re^3: Scraping Ajax / JS pop-up

Monk-E, everything that JavaScript does is client-side, so it has to send a request back to the server at some point, and you can just use Perl to mimic that request. If you want a solution that completely automates JavaScript in any situation then you need to make a script that parses JavaScript, which would take an enormous amount of time.
Instead you might,for example, download firebug for FireFox, right click and Inspect the Element of the particular button you're wandering about and see what address is being requested from the server, use regular expressions to isolate that address and then just have your script get() that address and continue.

He picked the perl from the dying flesh and held it in his palm, and he turned it over and saw that its curve was perfect in the hand he had smashed against the gate; the torn flesh of the knuckles was turned grayish white by the sea water. ~Steinbeck's "The Perl"

Comment on Re^3: Scraping Ajax / JS pop-up

Replies are listed 'Best First'.
Re^4: Scraping Ajax / JS pop-up by Monk-E (Initiate) on Feb 16, 2012 at 02:50 UTC
Thanks. There is a theme here. I'll definitely look into this direction. Guess I had hope that the module plug-ins for handling JavaScript would be able to handle this (and perhaps I was overlooking a powerful module or function or misusing). Thanks for a pointer in the right direction.	[reply]