Re^2: how to parsing web page or get some keywords

For example, there is a shopping books web site, many books showed on 1 page, 2 page, 3page...and so on. Now I want get or fetch these books name or more info in all site. So which modules can I use? If give me some Demo it is best . Thx

Comment on Re^2: how to parsing web page or get some keywords

Replies are listed 'Best First'.
Re^3: how to parsing web page or get some keywords by Anonymous Monk on Jul 20, 2016 at 00:10 UTC
WWW::Mechanize (and alikes) to get webpages, then htmltreexpather.pl or xpather.pl to give you xpaths to get at the data you want then give xpaths to HTML::TreeBuilder::XPath or XML::LibXML or XML::XSH2, examples (and links to ) Re: Perl LWP Router login, Re^2: www::mechanize: second "submit" invisible to find_all_submits, Re: LWP::UserAgent doesn't send my HTTP::Cookies (trace/debug), Re^2: Merging two anchors with HTML::TreeBuilder, examples(for tree-xpath and others)/walkthroughs/tutorials ..., Re: question about lookaheads and threatexpert/html parsing, Re: Encode double encoding?, Re: Parsing XML output from `qstat`,	[reply]

Replies are listed 'Best First'.

Re^3: how to parsing web page or get some keywords
by Anonymous Monk on Jul 20, 2016 at 00:10 UTC

WWW::Mechanize (and alikes) to get webpages,

then htmltreexpather.pl or xpather.pl to give you xpaths to get at the data you want

then give xpaths to HTML::TreeBuilder::XPath or XML::LibXML or XML::XSH2,

examples (and links to ) Re: Perl LWP Router login, Re^2: www::mechanize: second "submit" invisible to find_all_submits, Re: LWP::UserAgent doesn't send my HTTP::Cookies (trace/debug), Re^2: Merging two anchors with HTML::TreeBuilder, examples(for tree-xpath and others)/walkthroughs/tutorials ..., Re: question about lookaheads and threatexpert/html parsing, Re: Encode double encoding?, Re: Parsing XML output from `qstat`,

[reply]