Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re^5: Module hierarchy help

by Asim (Hermit)
on Jul 27, 2006 at 15:44 UTC ( [id://564136]=note: print w/replies, xml ) Need Help??


in reply to Re^4: Module hierarchy help
in thread Module hierarchy help

Have ye considered the wonders that WW::Mechanize would do for your coding? It's a module to simulate a browser for purposes of interacting on a website. With the help of HTTP::Recorder, you can even do it once manually, and have the module build the WWW:Mechanize script you need for your apps.

Based upon what you've written, I'd strongly consider those options, and doing some research upon them. The docs I've linked to above, plus Googling for the module names, will lead to a wealth of resources.

Think that might help remove a layer or two of work and code for you?

----Asim, known to some as Woodrow.

Replies are listed 'Best First'.
Re^6: Module hierarchy help
by 2ge (Scribe) on Jul 27, 2006 at 17:05 UTC
    thanks, I am already using WWW::Mechanize(::Cached), doing by hand, no need for HTTP::Recorder. This is not about downloading itself (BASE class for sure), but which links to visit, every web has another hierarchy and thats the problem. It is something like you want to parse news from webs: yahoo news, bbc news, google news and so on.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://564136]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others lurking in the Monastery: (3)
As of 2024-04-25 23:39 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found