in reply to Testing proxy "health"

I once dealt with this problem by giving each proxy N chances to fail, and after one reached N failures, I'd remove it from the list. It was a pound of cure rather than an ounce of prevention, but it more or less did the job. This method was used in a program where I was hitting 60-100 proxies at a time, so having a few not working at any given moment wasn't of high importance as long as things settled out eventually.

Replies are listed 'Best First'.
Re: Testing proxy "health"
by hacker (Priest) on Oct 22, 2007 at 18:11 UTC

    Can you explain to me how you were able to "kill" the running process trying to reach a dead, down, unavailable proxy?

    I've tried this, and once I attempt to access content via a down proxy in my array, I have to sit and wait until that proxy times out, before I can try again.

    I'm not sure how to capture that "downed" state, kill the process attempting to use that proxy, and then loop across another proxy until I find one that works.

[reply]

      What about just setting a shorter timeout?

      non-Perl: Andy Ford

[reply]
        Bingo, this is what I did.
[reply]

In Section Seekers of Perl Wisdom