in reply to Hiya Monks!

Google is your friend: Python Scrapy Perl which links to StackOverflow which, in turn, links to The State of Web spidering in Perl.

#11929 First ask yourself `How would I do this without a computer?' Then have the computer do it the same way.

Replies are listed 'Best First'.
Re^2: Hiya Monks!
by Anonymous Monk on Dec 20, 2013 at 08:52 UTC

    ...

    Which doesn't exactly answer the question :)