I'm uploading a lot of data through the databases in metaweb and freebase, If you've used their services before you'll know that you can't upload lots of data at one time, I'm trying to write a script that will just upload all the datasets that I have overnight and I wouldn't have to worry about manually changing things. Do you know if it's possible to do something like that?

It works like this :

#!/usr/bin/perl -w 
use strict;
use LWP::UserAgent;

my $ua = LWP::UserAgent->new;
$ua->timeout(10);

my @proxies = ( 
    'http://proxy.no1:8001/', 'http://proxy.no2:8002/', 'http://proxy.
+no3:8003//', 'http://proxy.no4:8004/'
);

for (@proxies) {
    $ua->proxy( [ 'http', 'ftp' ] => $_ );
    my $req = HTTP::Request->new( 'GET', "http://search.cpan.org/" );
    my $res = $ua->request($req);
    next unless $res->is_success;
    print $res->decoded_content;
    last; # Update
}
[download]

hth,
PooLpi