Re^4: Creating a web crawler (theory)

You don't have to hunt down and re-type the links when you use a Perl script to do it for you. :)

--
brian d foy <bdfoy@cpan.org>

Comment on Re^4: Creating a web crawler (theory)

Replies are listed 'Best First'.
Re^5: Creating a web crawler (theory) by gaal (Parson) on Jan 29, 2005 at 16:26 UTC
But then you have to write and debug a Perl script :) (Have it treat programmatically constructed paths etc.)	[reply]
Re^6: Creating a web crawler (theory) by brian_d_foy (Abbot) on Jan 29, 2005 at 18:06 UTC
Programmatically constructed paths? You mean like templates? In that case, you shouldn't have much re-typing to do at all. It's a pretty simple script to rewrite URLs. It's even one of the class exercises in one of the Stonehenge courses. :) -- brian d foy <bdfoy@cpan.org>	[reply]