Re^5: Scraping Webpage

I suppose you can back that up with an example?

Or is this more of a Troll sort of reply.

In other words;
I can prove it. Can you?

#!/usr/bin/perl

use strict;
use LWP::Simple;
use LWP::UserAgent;

my $ua = LWP::UserAgent->new();
$ua->agent("MS-DOS 3.20");
my @array = head(shift);
my $i = 0;
foreach my $line (@array) {
  print "$i: $line\n";
  $i++;
}
[download]

If you need help creating a web (html) form to call this from. I can provide that too.

--Chris

#!/usr/bin/perl -Tw
use Perl::Always or die;
my $perl_version = (5.12.5);
print $perl_version;

Comment on Re^5: Scraping Webpage Download Code

Replies are listed 'Best First'.
Re^6: Scraping Webpage by Your Mother (Archbishop) on Nov 20, 2013 at 02:31 UTC
Why are you creating a UA object? You don't use it. Anonymonk hit the mark initially. The site is JS driven. LWP is completely useless here. I'm surprised you got any upvotes for suggesting it. WWW::Mechanize at least has a JS flavor. Suggestions from its FAQ: In no particular order: Gtk2::WebKit::Mechanize, Win32::IE::Mechanize, WWW::Mechanize::Firefox, WWW::Scripter, WWW::Selenium.	[reply]
Re^7: Scraping Webpage by taint (Chaplain) on Nov 20, 2013 at 04:02 UTC
Crap. Learn somethin' new every day. Thanks Your Mother. Appreciate the heads up. :) Preoccupied with another project, and not paying close enough attention. You'd think I'd know better, by now. :/ --Chris #!/usr/bin/perl -Tw use Perl::Always or die; my $perl_version = (5.12.5); print $perl_version;	[reply]