my $www = WWW::Mechanize->new();
$www->get($url);
print $www->content();
[download]

302 is a redirection response. The response will also contain an URL that will need to be accessed. Looks like LWP::Simple doesn't handle this automatically. You probably need to use another of the LWP modules.

LWP::Simple uses LWP::UserAgent. LWP::UserAgent normally follows redirects. It won't follow redirects received from POST responses by default, however. Consult the docs for LWP::UserAgent to add POST to the list of methods for which redirects are allowed. (You won't be able to use LWP::Simple if this is the problem.)

There is a little bit of JS magic going on when you first visit and get cookied. The actual request to the resource requires no JS but getting through https://webapp4.asu.edu/catalog/Home.ext to obtain a valid cookie seems to. I have the basics worked out with WWW::Mechanize::Firefox but tonight is the first time I ever got it to install so I have little experience with it. I’ll update tomorrow (might be late in the day after work) with code that at least does something on which you can build.

*Brittle* but works right now… exercise for the reader to correlate headers with data or dig deeper or adjust scraping. I would really think that if you’re a TA, GA, or prof or whatever that the university would probably install a crontab for you that would be *much* more robust. Something like–

–would be pretty trivial on the backend for someone I would think. Certainly easier and more likely to keep working than–

#!/usr/bin/env perl
use strict;
use warnings;
use WWW::Mechanize::Firefox;
use HTML::TableExtract;

# Firefox will be in a different place/name for different architecture
+s.
my $mech = WWW::Mechanize::Firefox->new(
    activate => 1,
    autoclose => 1,
    launch => "/Applications/Firefox.app/Contents/MacOS/firefox" );

$mech->get("https://webapp4.asu.edu/catalog/Home.ext");

eval {
    my ( $val,$type ) = $mech->eval_in_page(<<'JS');
    jQuery(function($){
       // Click the ASU campus+online radio button.
       $("input[name='typeSelection'][value='C']").click();
    });
JS
};
die $@ if $@;

# Get the desired search result page.
$mech->get("https://webapp4.asu.edu/catalog/course?s=MAT&n=243&c=DTPHX
+&t=2144&f=INTRT&r=44843");

my @headers = ( qr/ Reserved \s+ Available \s+ Seats /x,
                qr / Students \s+ Enrolled /x,
                qr/ Total \s+ Seats \s+ Reserved /x,
                qr/ Reserved \s+ Until /x, );

my $te = HTML::TableExtract->new( headers => \@headers );
$te->parse($mech->content);

for my $row ( $te->rows )
{
    no warnings "uninitialized";
    s/\A\s+//g, s/\s+\z//g, s/\s/ /g for @$row;
    next unless grep length, @$row;
    print "Scraped info: ", join(',', @$row), "\n";
}
[download]

Reading: WWW::Mechanize::Firefox, HTML::TableExtract, jQuery (note, they are using a positively ancient version right now: 1.2.3).