in reply to Re^2: Connection Timeout duing form submissions
in thread Connection Timeout duing form submissions

Ok. I will suggest this again, run your program for some dates like August 1, 1921 to December 23, 1922.

I think also that you should be "polite" regarding number of hits per second on the other website. The previous poster suggested this and I agree.

Get your script working on a limited date range. Then expand that date range. Get your data and then "shut up". I would put some "sleep()" into the script and just let it run for a day. The data from 1920 isn't going to change. For your school project the objective shouldn't be: how to get this data as fast as possible, it should just be: how do I get this data?

I also haven't yet seen any "this is what was sent" (the actual stuff) vs "this is what I received". I haven't seen any boundary test cases based upon what you have heard so far.

  • Comment on Re^3: Connection Timeout duing form submissions