in reply to blocking site scrapers
As someone else has mentioned, those particular addresses are AOL proxies, which indicates that you may want to score whole address ranges instead of individual addresses. This snippet from one of the scripts I use when hunting spammers will help.
use Net::DNS; my $IP = '64.12.116.67'; my($ASN, $network, $network_bits) = @{ Net::DNS::Resolver->new() ->query(join('.', reverse(split(/\./, $IP))).".asn.routeviews.or +g", "TXT", "IN") ->{answer}->[0]->{char_str_list} }; print "$network/$network_bits\n";
|
|---|