Re: Occasional Read Timeout with Mech

you can parallely give a try to mine similar project using LWP::UserAgent and compare the results. You can set a different timeout within the latter and do other comparisons. You can also find an increasing response time before timeouts

You can find it here

webTimeLoad23.pl --count 1000 --verbosity 0 --protocol https --sleep 6
+0 --timeout 120 --url www.yoururl.org
[download]

HtH
L*

There are no rules, there are no thumbs..
Reinvent the wheel, then learn The Wheel; may be one day you reinvent one of THE WHEELS.

Comment on Re: Occasional Read Timeout with Mech Download Code

Replies are listed 'Best First'.
Re^2: Occasional Read Timeout with Mech by pirkil (Beadle) on Dec 17, 2014 at 12:17 UTC
I was also thinking about the timeout & response time increase. I will try it.	[reply]
Re^3: Occasional Read Timeout with Mech by benwills (Sexton) on Dec 17, 2014 at 23:45 UTC
In the millions of typical web page requests I make, the vas majority are completed, from start to finish, in 4 seconds. How large is the file being requested that a 60 second timeout might be too low?	[reply]