Hi monks

I'm working on a script that crawls a website and reports on any pages that return a 401 status code. The aim is to identify any pages that accept Basic Authentication over plain http (and therefore passwords sent in clear text). Below is a simplified version with the relevant code: 

use strict;
use LWP::UserAgent;

my $ua = LWP::UserAgent->new;
my $uri = shift @ARGV;
my $headreq = HTTP::Request->new(HEAD => $uri);        
my $headres = $ua->request($headreq);        
my $statuscode = $headres->code();        
print "Status 401 at $uri\n" if $statuscode == 401;

[download]
This works fine until we apply the solution, which is for the server to redirect us to the same address starting https://. If I visit one of these 'fixed' pages with a browser and look at the headers, I see a request for http://page followed by a 302 response which redirects to https://page and then a 401 response. My perl script, however, tells me "Status 401 at http://page", which for my purposes is a false positive. Can anyone think of a better way to do this?

cheers

memwaster

In reply to HTTP status codes by memwaster

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.