Re^2: How to extract xpath from the webpage

Hi Corion, I am doing web page automation to find the links, text and image links by using selenium,which uses xpath to locate the links like "//td2/div/a/img" from the web page source. I am trying.
I am trying with Html::TreeBuilder::xpath, i don't know what are all the other modules i can import in my script.

Comment on Re^2: How to extract xpath from the webpage

Replies are listed 'Best First'.
Re^3: How to extract xpath from the webpage by Corion (Patriarch) on Nov 04, 2009 at 08:10 UTC
If Selenium supports XPath queries, you don't need any Perl XPath modules. If you want to access Selenium and its results, see WWW::Selenium. If you want to use HTML::TreeBuilder::XPath, I'm not sure where your actual problem in your code is. The "synopsis" section shows how to extract HTML fragments from a given HTML string. Maybe you want to fetch the images using LWP::UserAgent then? Personally, I automate websites with WWW::Mechanize::FireFox, which supports Javascript (and XPath).	[reply]

Replies are listed 'Best First'.

Re^3: How to extract xpath from the webpage
by Corion (Patriarch) on Nov 04, 2009 at 08:10 UTC

If Selenium supports XPath queries, you don't need any Perl XPath modules. If you want to access Selenium and its results, see WWW::Selenium. If you want to use HTML::TreeBuilder::XPath, I'm not sure where your actual problem in your code is. The "synopsis" section shows how to extract HTML fragments from a given HTML string. Maybe you want to fetch the images using LWP::UserAgent then?

Personally, I automate websites with WWW::Mechanize::FireFox, which supports Javascript (and XPath).

[reply]