in reply to Mech follow_link

heres some code that i did ....
#!/usr/bin/perl -w use strict; use WWW::Mechanize; my $q = $ARGV[0] || die("\nusage : ".$0." query 3 spaces\n\n"); $q .= ' '.$ARGV[1] if ($ARGV[1]); $q .= ' '.$ARGV[2] if ($ARGV[2]); my $url = 'http://www.google.co.uk'; my $mech = WWW::Mechanize->new(agent => "WWW"); $mech->get($url); $mech->submit_form(form_name => 'f',fields => {'q' => $q}, button => ' +btnG'); for my $i (1..200) { print "page : ".$i."\n"; dosomat($mech->content); my $next = $mech->find_link( text_regex => qr/Next$/, url_regex => q +r/^\/search\?/) or die("finished on page : ".$i."\n"); $mech->get($url.$next->url); } exit(0); sub dosomat { my ($content) = @_; my @cont = $content =~ m{<div class=g(.*?)</div>}gsi; for my $i (0..$#cont) { print $cont[$i]."\n\n\n"; } }


i had the same problem, found that the link had div tags within it.

google wont let me use there services since i ran this script a couple of times, :(