I'm trying to automate logging into a webpage.

You first go to http://mysite.com/ and it redirects you to a https page where the URL is encoded with some encrypted string. You the post your username to a script on the page, then the same script sends you a new page and asks you for your password before it lets you in. This site needs you to use cookies.

My question is:
1. Is my virtual browser keeping the "referrer" in the head as the previous pages I visited? IE, is that crazy string in the URL of the first page I was redirected to set as my Referrer?

2. Am I grabbing and keeping my cookies properly?

3. I'm getting Error: "302 Moved" after I enter my password. 302 States: If the 302 status code is received in response to a request other than GET or HEAD, the user agent MUST NOT automatically redirect the request unless it can be confirmed by the user, since this might change the conditions under which the request was issued."

So how do I allow the LWP virutal browser I created to automatically redirect instead of erroring out. If I remove the Die code the content doesn't update

#!/usr/bin/perl -w

use strict;
use LWP;

my $site0 = "http://mysite.com/
my $site = "https://login.mysite.com/dir/auth";

my @netscape_headers = (  # Set headers to look like Netscape
    'User-Agent' => 'Mozilla/4.76 [en] (Win98; U)',
    'Accept-Language' => 'en-US',
    'Accept-Charset' => 'iso-8859-1,*,utf-8',
    'Accept-Encoding'=> 'gzip',
    'Accept' => "image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, 
+image/png, */*",
);

my $browser = LWP::UserAgent->new();   # Create virtual browser
$browser->cookie_jar( {} );            # Enable cookies

my $response = $browser->get($site0, @netscape_headers);
die "Error: ", $response->status_line
 unless $response->is_success;

my $response = $browser->post(
 $site,
 [
   "pRedirect" => "",
   "fRedirect" => "",
   "SafeWordUser" => "username"
 ]
);
die "Error: ", $response->status_line
 unless $response->is_success;

print $response->content();

$response = $browser->post(
 $site,
  [
   "pRedirect" => "",
   "fRedirect" => "",
   "SafeWordPassword" => "password"
 ]
);
die "Error: ", $response->status_line
 unless $response->is_success;

print $response->content();
[download]

Any other suggestions for this scipt would be apprecieated. The only reason I print response->content() is for debugging purposes.


UPDATE:

Here's my new code, it logs in to the main page okay. To get arround the "302 Moved" error I got rid of the "die" code and manually went to a secured page. If you use a normal browser a pop-up window comes up instead of the 302 error, the browser asks if you want to view non secure elements. I don't know how to automate this into the script.

#!/usr/bin/perl -w

use strict;
use LWP;

my $site = "https://login.mysite.com/dir/auth";
my $site1 = "https://www.mysite.com/protected/dir/main.htm";

my @netscape_headers = (          # Set headers to look like Netscape
    'User-Agent' => 'Mozilla/4.76 [en] (Win98; U)',
    'Accept-Language' => 'en-US',
    'Accept-Charset' => 'iso-8859-1,*,utf-8',
    'Accept-Encoding'=> 'gzip',
    'Accept' => "image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, 
+image/png, */*",
);

my $browser = LWP::UserAgent->new();   # Create virtual browser
$browser->cookie_jar( {} );            # Enable cookies

my $response = $browser->post(
 $site,
 [
   "pRedirect" => "",
   "fRedirect" => "",
   "User" => "username"
 ],@netscape_headers
);
die "Error: ", $response->status_line
 unless $response->is_success;


 $response = $browser->post(
 $site,
  [
   "pRedirect" => "",
   "fRedirect" => "",
   "Password" => "password"
 ],@netscape_headers
);

$response = $browser->get($site1, @netscape_headers);
print $response->content();
[download]