in reply to Mass downloads.
Time how long a fetch takes, add at least a few seconds to that, and then wait at least that long before starting the next fetch. That should do a pretty good job of preventing server overload for batches of requests that only get run rarely.
Note that I mean for you to time each fetch. If the server gets bogged down, then your script should immediately notice that the previous fetch took longer and automatically compensate by waiting longer before trying the next fetch.
Thanks.
- tye
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^2: Mass downloads. (N+5)
by gaal (Parson) on May 20, 2005 at 21:46 UTC | |
by exussum0 (Vicar) on May 20, 2005 at 22:09 UTC | |
Re^2: Mass downloads. (N+5)
by BrowserUk (Patriarch) on May 21, 2005 at 17:02 UTC | |
by valdez (Monsignor) on May 22, 2005 at 09:59 UTC | |
by exussum0 (Vicar) on May 25, 2005 at 19:46 UTC | |
by BrowserUk (Patriarch) on May 25, 2005 at 20:39 UTC |
In Section
Perl Monks Discussion