in reply to Re^2: Creating a web crawler (theory)
in thread Creating a web crawler (theory)

Relative URLs do better than save typing. They save retyping. If you move a project inside a site or just rename it, with relative paths you don't have to hunt down all the links and change them.

Replies are listed 'Best First'.
Re^4: Creating a web crawler (theory)
by brian_d_foy (Abbot) on Jan 29, 2005 at 15:42 UTC

    You don't have to hunt down and re-type the links when you use a Perl script to do it for you. :)

    --
    brian d foy <bdfoy@cpan.org>
      But then you have to write and debug a Perl script :)

      (Have it treat programmatically constructed paths etc.)

        Programmatically constructed paths? You mean like templates? In that case, you shouldn't have much re-typing to do at all.

        It's a pretty simple script to rewrite URLs. It's even one of the class exercises in one of the Stonehenge courses. :)

        --
        brian d foy <bdfoy@cpan.org>