Re^5: Creating a web crawler (theory)

But then you have to write and debug a Perl script :)

(Have it treat programmatically constructed paths etc.)

Comment on Re^5: Creating a web crawler (theory)

Replies are listed 'Best First'.
Re^6: Creating a web crawler (theory) by brian_d_foy (Abbot) on Jan 29, 2005 at 18:06 UTC
Programmatically constructed paths? You mean like templates? In that case, you shouldn't have much re-typing to do at all. It's a pretty simple script to rewrite URLs. It's even one of the class exercises in one of the Stonehenge courses. :) -- brian d foy <bdfoy@cpan.org>	[reply]