in reply to Re^2: Connection Timeout duing form submissions
in thread Connection Timeout duing form submissions
I think also that you should be "polite" regarding number of hits per second on the other website. The previous poster suggested this and I agree.
Get your script working on a limited date range. Then expand that date range. Get your data and then "shut up". I would put some "sleep()" into the script and just let it run for a day. The data from 1920 isn't going to change. For your school project the objective shouldn't be: how to get this data as fast as possible, it should just be: how do I get this data?
I also haven't yet seen any "this is what was sent" (the actual stuff) vs "this is what I received". I haven't seen any boundary test cases based upon what you have heard so far.
|
|---|