Re: Re: Merlyns Web Link checker

Please forgive me for asking, but why? (sorry if that's lame, but I really don't get your meaning from the context.)

I'll admit that I'm not an admin, but why wouldn't I want to make sure the links are good on a site I frequent? Wouldn't it save me some time to avoid the bad ones up front?

Comment on Re: Re: Merlyns Web Link checker

Replies are listed 'Best First'.
•Re: Re: •Re: Merlyns Web Link checker by merlyn (Sage) on Feb 28, 2002 at 16:28 UTC
It's not your job to check the links of someone else's site. The link checker doesn't respect the Robot Rules, and will wander blindly into robot-hostile territory. You wouldn't believe the number of lamers that come check stonehenge.com's site hitting thousands of robot-hostile URLs because the first few versions of this program had a live URL pointing at my site. I finally put a very-early block in my website to keep people from doing it. And it still happens! And I no longer use live URLs in my examples. Some people are just Lacking Clue. -- Randal L. Schwartz, Perl hacker	[reply]

Replies are listed 'Best First'.

•Re: Re: •Re: Merlyns Web Link checker
by merlyn (Sage) on Feb 28, 2002 at 16:28 UTC

It's not your job to check the links of someone else's site.
The link checker doesn't respect the Robot Rules, and will wander blindly into robot-hostile territory.

You wouldn't believe the number of lamers that come check stonehenge.com's site hitting thousands of robot-hostile URLs because the first few versions of this program had a live URL pointing at my site. I finally put a very-early block in my website to keep people from doing it. And it still happens! And I no longer use live URLs in my examples. Some people are just Lacking Clue.

-- Randal L. Schwartz, Perl hacker

[reply]