Re: Investigating connection reset with LWP to an https site

I recommend you login via browser with Javascript disabled and check all params sended by your browser to the target site (via Firefox's HTTPFox or Opera's Dragonfly).

Next you just need to send all these params from your script (Referer, cursor click x and y etc.)

Thanks.
Roman

Comment on Re: Investigating connection reset with LWP to an https site

Replies are listed 'Best First'.
Re^2: Investigating connection reset with LWP to an https site by sedusedan (Pilgrim) on Mar 06, 2012 at 02:02 UTC
To restate my problem: I'm getting a connection reset error instead of the site changing HTML/layout/design/JavaScript (it doesn't, BTW). The module can't even retrieve a single page, like the front page or the login page, from the site. So I'm still guessing it has to do with the network layer like LWP or Crypt::SSLeay.	[reply]
Re^3: Investigating connection reset with LWP to an https site (packets) by tye (Sage) on Mar 06, 2012 at 02:31 UTC
RESET can happen for lots of different reasons. They could even be suddenly breaking the connection after they see your user agent string. I'd get more information by capturing packets with wireshark to compare the different scenarios. - tye	[reply]
Re^4: Investigating connection reset with LWP to an https site (packets) by sedusedan (Pilgrim) on Mar 06, 2012 at 14:24 UTC
Thanks for the advice. Since HTTPS is encrypted and the LWP's source is at hand, I just let LWP print out (uncomment one line, really) the HTTP header it's sending, and the culprit turns out to be the Transfer-Encoding (TE) header. I'll be bugging Gisle Aas again to give LWP the option of not sending TE header.	[reply]