in reply to WWW::Mechanize to traverse LinkedIn social networking site

Not sure exactly what you're doing in the code but i guess you're simply retrieving the initial page and trying to do likewise for the list of friends. more than likely you'll need to send a POST request for these links, with appropriate parameters. the parameters can be sent separately or in the url of a POST request. In any case, to be sure, record a few click-through sessions with something like Ethereal running...to see what is exactly sent and received. looking at browser alone doesn't tell full story.
btw...how are you going to handle the condition of "your friend's friend has you as their friend"..and similar conditions? if not careful, you can make endless loops there, or get wrong answers to questions. in fact, a relational database (structure) may not handle this very well at all...so a hierarchial DB (structure) could be better.
good luck
the hardest line to type correctly is: stty erase ^H
  • Comment on Re: WWW::Mechanize to traverse LinkedIn social networking site

Replies are listed 'Best First'.
Re^2: WWW::Mechanize to traverse LinkedIn social networking site
by koknat (Sexton) on Oct 26, 2007 at 02:31 UTC
    Thanks for the tip about Ethereal.

    A clarificiation. I'm not trying to crawl the entire site. I'm just trying to jump to each of my 86 friends, and record the names of their friends. This prevents the endless loop problem from happening.

    Also, LinkedIn only lets you see your friend's friends (2 degrees of separation). You can't even see your friend's friend's friends.