in reply to Re: perl regex or module that identifies bots/crawlers
in thread perl regex or module that identifies bots/crawlers
Thus my earlier suggestion of matching ips(here's one range for slurp I use..there are more /^72\.30\.\d+\.\d+$/ ) with user agents (/slurp/).
It tends to do us justice.
--D
|
|---|