Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Graphical overview of web site linking

by Bukowski (Deacon)
on Nov 22, 2002 at 16:20 UTC ( [id://215150]=perlquestion: print w/replies, xml ) Need Help??

Bukowski has asked for the wisdom of the Perl Monks concerning the following question:

Hello brother Monks,

I have just been approached with a question - someone has asked me if its possible to display the structure of a web pages linkage graphically, ie producing a graphical representation of a web spider/crawler output.

I have googled extensively, but I cannot find an appropriate solution, and he is looking for a Perl solution to this problem - is anyone aware of any modules that might be appropriate? Or even modules that could help him build his own application?

I imagine such a thing must exist, but maybe my search skills are eluding me on a long, cold, wet Friday afternoon.

Thanks in anticipation of your wisdom.

Bukowski - aka Dan (dcs@black.hole-in-the.net)
"Coffee for the mind, Pizza for the body, Sushi for the soul" -Userfriendly

Replies are listed 'Best First'.
Re: Graphical overview of web site linking
by jkahn (Friar) on Nov 22, 2002 at 18:06 UTC
    This is a neat idea.

    I don't know of any pre-packaged solution, but I imagine that whipping up Graph objects from a crawler output wouldn't be too hard.

    Then you can use Graph::ReadWrite (specifically, the Graph::Writer::Dot module) to dump them to a .dot file (for use with http://www.graphviz.org's dot tool). This gives pretty graphical output, though sometimes big.

    It never ceases to amaze me how much more impressed the pointy-heads are when you have pretty pictures.

[reply]
Re: Graphical overview of web site linking
by traveler (Parson) on Nov 22, 2002 at 18:06 UTC
    There are lots of tools for this. I do not know which are perl and which are not. Some appear to be Java. Here are a couple of pointers (pun intended):

    One tool is webtracer; cybergeography has links to lots of other tools.

    HTH, --traveler

[reply]

Back to Seekers of Perl Wisdom

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?

www.com | www.net | www.org
Node Status?
node history
Node Type: perlquestion [id://215150]
Approved by robartes
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? • Last hour • Other CB clients
Other Users?
Others scrutinizing the Monastery: (5)
As of 2024-04-26 08:09 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found