in reply to Re: Need to limit robot depth using WWW::Robot
in thread Need to limit robot depth using WWW::Robot
Ah. Good question. I did mean levels deep within the site hierarchy.
And I like the idea of counting slashes. I'll give it a go.
Interesting that this is not obviously (to me) intrinsic to WWW::Robot. I expected that acceptable robot behavior suggests a limit to within-site depth, and that this would somehow be part of the package.
Either way, I have a solution. Thanks.
-Michael