in reply to Re: How to get an HTML table from the document using WWW::Mechanize::Firefox ?
in thread How to get an HTML table from the document using WWW::Mechanize::Firefox ?

I tried it right after our email exchange, it didn't work for me

Here is a piece of my code: 

....
my $id="search_result_next_page_link"; 
 
$mech->click({ xpath => qq{//*[\@id="$id"]}, synchronize => 0 }); 

sleep 2;
    

my @tt= $mech->xpathEx(xpath=>'/html/body/form/div[4]/div/main/div/div
+[3]/section/div/div/table/');


print $tt[0]->{innerHTML};


print "\n---\n";

[download]

....

And here is what I get: 

 >perl search_scotia.pl
Use of uninitialized value in print at search_scotia.pl line 37.

---

[download]

Property {'innerHTML'} returns nothing...

Replies are listed 'Best First'.
Re^3: How to get an HTML table from the document using WWW::Mechanize::Firefox ?
by Corion (Patriarch) on Oct 28, 2014 at 20:54 UTC

    Then your XPath query did not return anything.

    Please post a short, self-contained program that reproduces the problem. That will help us reproduce the problem and maybe find a solution.

    Looking at the HTML of that link you posted, why don't you use the class of the target element? 

    $mech->selector('.tableSearchResults')?</p>
<p>Also note that the first argument to <c>->xpathEx

    [download]
    is the XPath query, not xpath.

    After fixing that part, Firefox complains that your XPath query is invalid syntax. After fixing that, your XPath query seems to go astray somewhere because no elements are found. Maybe you want to try the following small example?

    use strict;
use warnings;
use WWW::Mechanize::Firefox;

my $mech= WWW::Mechanize::Firefox->new();
$mech->get('http://jobs.scotiabank.com/search/advanced-search/ASCatego
+ry/IT/ASPostedDate/-1/ASCountry/Canada/ASState/Ontario/ASCity/Toronto
+/ASLocation/-1/ASCompanyName/-1/ASCustom1/-1/ASCustom2/-1/ASCustom3/-
+1/ASCustom4/-1/ASCustom5/-1/ASIsRadius/false/ASCityStateZipcode/-1/AS
+Distance/-1/ASLatitude/-1/ASLongitude/-1/ASDistanceType/-1');

my $id="search_result_next_page_link";
$mech->click({ xpath => qq{//*[\@id="$id"]}, synchronize => 0 }); 

sleep 2;

my @tt= $mech->xpathEx(xpath=>'/html/body/form/div[4]/div/main/div/div
+[3]/section/div/div/table/');
print 0+@tt;

print $tt[0]->{innerHTML};

print "\n<--- bad API usage\n";

@tt= $mech->xpathEx('/html/body/form/div[4]/div/main/div/div[3]/sectio
+n/div/div/table');
print 0+@tt;

print $tt[0]->{innerHTML};

print "\n<--- fixed XPath\n";

@tt= $mech->selector('.tableSearchResults');
print 0+@tt;

print $tt[0]->{innerHTML};

print "\n<--- CSS\n";

    [download]
[reply]
[d/l]
[select]

      Thank you Max, CSS part works

      I am not posting my code, because it's very similar to the one you provided

      Still not clear why this part  @tt= $mech->xpathEx('/html/body/form/div[4]/div/main/div/div[3]/section/div/div/table/' ); not working, because xpath iself is for this table for sure.

      Anyway, as long as, I can get the HTML code for the table, one way or another, it's fine with me

      Thanks again..Also, would be nice to include couple of examples like this in the the WWW::Mechanize ::Firefox cookbook

[reply]
[d/l]

        I had to piece together my example from the code snippets you provided. I think it's appropriate for you to do that work instead of expecting me to create a working program from incomplete and buggy lines of code that you provide.

[reply]

In Section Seekers of Perl Wisdom