crawling one website

vit has asked for the wisdom of the Perl Monks concerning the following question:

Replies are listed 'Best First'.
Re: crawling one website by marto (Cardinal) on May 27, 2011 at 16:47 UTC
See the answers to your previous question. If you have further questions let us know.	[reply]
Re: crawling one website by planetscape (Chancellor) on May 27, 2011 at 19:11 UTC
`hgrepurl.pl` from the book Web Client Programming with Perl, full text freely available from the O'Reilly Open Books Project, can get you your links. w3mir from the CPAN can fetch a list of links, and can control the depth of recursion. HTH, planetscape	[reply] [d/l]
Re^2: crawling one website by vit (Friar) on May 28, 2011 at 14:39 UTC
Thanks! I tried hgrepurl.pl with and without parameters but it does not print anything. Could you give me a usage example without proxy.	[reply]
Re^3: crawling one website by vit (Friar) on May 28, 2011 at 14:50 UTC
Actually I got: `perl -W hgrepurl.pl http://www.senopt.com Subroutine Cwd::fastcwd redefined at c:/ActivePerl/site/lib/Cwd.pm lin +e 812. Subroutine Cwd::getcwd redefined at c:/ActivePerl/site/lib/Cwd.pm line + 812. Subroutine Cwd::abs_path redefined at c:/ActivePerl/site/lib/Cwd.pm li +ne 812 main::get_html() called too early to check prototype at hgrepurl.pl li +ne 27.` [download] Is it serious? What should I do? I also checked: `perl -c hgrepurl.pl http://www.senopt.com hgrepurl.pl syntax OK` [download]	[reply] [d/l] [select]
Re^4: crawling one website by planetscape (Chancellor) on May 28, 2011 at 18:05 UTC
Re^5: crawling one website by vit (Friar) on May 29, 2011 at 00:56 UTC
Some notes below your chosen depth have not been shown here