in reply to Re: Need to limit robot depth using WWW::Robot
in thread Need to limit robot depth using WWW::Robot

Ah. Good question. I did mean levels deep within the site hierarchy. And I like the idea of counting slashes. I'll give it a go. Interesting that this is not obviously (to me) intrinsic to WWW::Robot. I expected that acceptable robot behavior suggests a limit to within-site depth, and that this would somehow be part of the package. Either way, I have a solution. Thanks. -Michael
  • Comment on Re: Need to limit robot depth using WWW::Robot