in reply to Occasional Read Timeout with Mech

you can parallely give a try to mine similar project using LWP::UserAgent and compare the results. You can set a different timeout within the latter and do other comparisons. You can also find an increasing response time before timeouts

You can find it here
webTimeLoad23.pl --count 1000 --verbosity 0 --protocol https --sleep 6 +0 --timeout 120 --url www.yoururl.org


HtH
L*
There are no rules, there are no thumbs..
Reinvent the wheel, then learn The Wheel; may be one day you reinvent one of THE WHEELS.

Replies are listed 'Best First'.
Re^2: Occasional Read Timeout with Mech
by pirkil (Beadle) on Dec 17, 2014 at 12:17 UTC
    I was also thinking about the timeout & response time increase. I will try it.

      In the millions of typical web page requests I make, the vas majority are completed, from start to finish, in 4 seconds. How large is the file being requested that a 60 second timeout might be too low?