Re^2: Detect Broken links

Replies are listed 'Best First'.
Re^3: Detect Broken links by CountZero (Bishop) on Oct 15, 2009 at 18:03 UTC
HTML::SimpleLinkExtor only gives you a list of the links in the webpage. To check if you can connect with the resource pointed to by the link I used the `head` function from LWP::Simple. In scalar context it returns TRUE if successful. If you need more detailed information you have to use LWP::UserAgent: `use strict; use warnings; use LWP::UserAgent; use HTML::SimpleLinkExtor; my $agent = LWP::UserAgent->new; my $extor = HTML::SimpleLinkExtor->new('http://www.perlmonks.org/'); $extor->parse_url('http://www.perlmonks.org'); print "Checking $_: ", $agent->head($_)->code, "\n" for $extor->links` [download] This will give you the HTTP status code. If you replace `->code` by `->message`, you get a human readable message instead of the three digit code. CountZero A program should be light and agile, its subroutines connected like a string of pearls. The spirit and intent of the program should be retained throughout. There should be neither too little or too much, neither needless loops nor useless variables, neither lack of structure nor overwhelming rigidity." - The Tao of Programming, 4.1 - Geoffrey James	[reply] [d/l] [select]

Replies are listed 'Best First'.

Re^3: Detect Broken links
by CountZero (Bishop) on Oct 15, 2009 at 18:03 UTC

HTML::SimpleLinkExtor

head

LWP::Simple

If you need more detailed information you have to use LWP::UserAgent:

use strict;
use warnings;

use LWP::UserAgent;
use HTML::SimpleLinkExtor;

my $agent = LWP::UserAgent->new;
my $extor = HTML::SimpleLinkExtor->new('http://www.perlmonks.org/');

$extor->parse_url('http://www.perlmonks.org');

print "Checking $_: ", $agent->head($_)->code, "\n" for $extor->links
[download]

->code

->message

CountZero

A program should be light and agile, its subroutines connected like a string of pearls. The spirit and intent of the program should be retained throughout. There should be neither too little or too much, neither needless loops nor useless variables, neither lack of structure nor overwhelming rigidity." - The Tao of Programming, 4.1 - Geoffrey James

[reply]
[d/l]
[select]