Re^2: Proxy link rotation

I need to use 250-300 different proxies, all these proxies require authorization, also I need some special filter for disabling and enabling proxies in proxy-list (something like grey list),etc . Is there any mechanisms to implement these things within your class?

Comment on Re^2: Proxy link rotation

Replies are listed 'Best First'.
Re^3: Proxy link rotation by OlegG (Monk) on Jan 28, 2012 at 04:43 UTC
I think you can `use strict; use LWP::UserAgent::Proxified; open( ROUTES, "<", "/etc/squid/repeater/lib/routes.cfg" ) or die "open: $!"; my @proxylist; while( <ROUTES> ) { s/#.//; next if /^(\s)$/; chomp; push @proxylist, http => "http://uname:passwd\@$_" if !/DISABLED/; } close(ROUTES); my $ua = LWP::UserAgent::Proxified->new( agent => undef, proxylist => \@proxylist, proxyrand => 1 ); # do the job` [download]	[reply] [d/l]

Replies are listed 'Best First'.

Re^3: Proxy link rotation
by OlegG (Monk) on Jan 28, 2012 at 04:43 UTC

use strict;
use LWP::UserAgent::Proxified;

open( ROUTES, "<", "/etc/squid/repeater/lib/routes.cfg" )
    or die "open: $!";

my @proxylist;
while( <ROUTES> ) {
    s/#.*//;
    next if /^(\s)*$/;
    chomp;
    push @proxylist, http => "http://uname:passwd\@$_" if !/DISABLED/;
}
close(ROUTES);

my $ua = LWP::UserAgent::Proxified->new(
    agent => undef,
    proxylist => \@proxylist,
    proxyrand => 1
);

# do the job
[download]

[reply]
[d/l]