Use LWP::UserAgent or Mojo::UserAgent

The datagrid is passed in json format from: http://dojotoolkit.org/documentation/tutorials/1.6/datagrid/demo/hof-batting.json

Parse that JSON data using JSON::XS

can't figure out how to extract data

use WWW::Mechanize::Firefox qw();
use HTML::TreeBuilder::LibXML qw();
my $mech = WWW::Mechanize::Firefox->new;
$mech->get('http://dojotoolkit.org/documentation/tutorials/1.6/datagri
+d/demo/datagrid-simple.html');
my $tree = HTML::TreeBuilder::LibXML->new;
$tree->parse($mech->content);
$tree->eof;
my $name = $tree->findvalue('/html/body/div/div[2]/div/div/div/div/div
+[2]/table/tbody/tr/td[2]');
[download]

I do know XPath.

More details: I'm trying to scrape a Blackberry Administration Service webpage, which is behind a firewall; otherwise I would have given that link.

I'm trying to get the element

//div\@id='dojox_grid__View_5'/div/div/div/div/table/tbody/tr/td20/span"

Which Chrome "Inspect element" sees, and the Selenium IDE sets every time -- but when I try to run against WWW:Mechanize it shows NO content, and the Selenium packages state that element does not exist.

Forgive me if the solution is obvious, but I *have* read the other posts -- and tried the code -- and have had no success.

Thats because you need to get() the JSON data which contains the actual table you want to scrape. The content you are getting is only the page that contains the JS functions and there should also be the ajax link in there you can use to get the actual data.

Once you get that link, get() it then parse the data from there.

When you hit the url for Dojo Demo the page you hit is the html page.

Once the page is loaded a call goes to url 'http://dojotoolkit.org/documentation/tutorials/1.6/datagrid/demo/hof-batting.json' to pull the JSON data.

my $mech = WWW::Mechanize->new();<br>
$mech->get('http://dojotoolkit.org/documentation/tutorials/1.6/datagri
+d/demo/hof-batting.json');<br>
[download]