Always use strict; and use warnings;. You don't define $__EVENTVALIDATION and $__VIEWSTATE that's why your code send empty values to the target site.

These values are located in the HTML form you receive from the target site and WWW::Mechanize will send these values automatically for you.

So usually you just need to provide login/password (and ParentUID in your example) to process auth page. May be you need to provide button name for the click()... Or may be this is some kind of Javascript magic (try to login in your browser with Javascript disabled)...

Also I'm sure that WWW::Mechanize::Firefox will work for such site (of course you must don't touch __VIEWSTATE and __VIEWSTATE).

#!/usr/bin/perl

use WWW::Mechanize;
my $mech = WWW::Mechanize->new();
my $url = ('http://www.folkeferie.dk/da/ferier/Aktuelle-chartertilbud-
+--afbudsrejser/');
$mech->get($url);
my $hsh={};
$links = $mech->find_all_links(url_regex=>qr/templates\/textPage\.aspx
+\?id/i, text_regex=>qr/Afbudsrejser/i);
    foreach my $link (@$links) {
              $url = $link->url_abs();
            $mech->get($url);
        my $content = $mech->content();
            while ($content=~/tr class="bgrow1"><td>(.*?)<\/td><td cla
+ss="countryValue">(.*?)<\/td><td class="destnameValue">(.*?)<\/td><td
+ class="hotelNameValue">(.*?)<\/td><td class="durationValue">(.*?)<\/
+td><td align="RIGHT" class="priceValue"><a target="_blank" href="(.*?
+)">(.*?)<\/a><\/td>/gisxm) {
            $hsh->{'url'} = $6;
        $hsh->{'crap_id'} = '';
        $hsh->{'date'} = $1;
        $hsh->{'country'} = $2;
        $hsh->{'destination'} = $3;
        $hsh->{'trip_type'} = $4;
        $hsh->{'trip_length'} = $5;
        $hsh->{'price'}=$7;
             print "$hsh->{'date'}, $hsh->{'country'}, $hsh->{'destina
+tion'}, $hsh->{'trip_type'}, $hsh->{'trip_length'}, $hsh->{'price'}, 
+$hsh->{'crap_id'}, $hsh->{'url'}, $airport\n\n";
        }
    }
[download]

Please have a look in this code and also check the link and tell me how can I scrape the details from here. Regards

This is less likely to get help than the node you messily copied and pasted it from.

My recommendation is to think up an actual programming question relating to the code you are presenting. Something along the lines of:

I'm trying to scrape a website. The following minimal code snippet is failing to produce the output I was expecting. I was expecting xyz, but instead I'm getting abc, plus an explosion of shards of solidified lava. I think the problem is with the pdq statement, but when I tried lmnop I got hot molten lava instead. How should I rewrite the thingamagizzer so that it would produce xyz rather than abc and hot lava?

(Fill in the variables and problem description as necessary to reflect the current situation)




Dave

hi,

Please format your code properly. Check How do I post a question effectively?
You can also consider using Perl::tidy on your script. Moreover, when you "copy" codes, you should atleast edit before re-posting. Check the "["download "]" at the end of your OP

Please check the code:

use WWW::Mechanize;
my $mech = WWW::Mechanize->new();
my @urls = ('http://www.folkeferie.dk/da/ferier/Aktuelle-chartertilbud
+---afbudsrejser/');
foreach my $url (@urls) {
    $mech->get($url);
    my $hsh={};
    $links = $mech->find_all_links(url_regex=>qr/templates\/textPage\.
+aspx\?id/i, text_regex=>qr/Afbudsrejser/i);
    foreach my $link (@$links) {
            $url = $link->url_abs();
            print "\n\n\n".$url."\n\n";
            $mech->get($url);
            my $content = $mech->content();
            print $content;
           while ($content=~/tr class="bgrow1"><td>(.*?)<\/td><td clas
+s="countryValue">(.*?)<\/td><td class="destnameValue">(.*?)<\/td><td 
+class="hotelNameValue">(.*?)<\/td><td class="durationValue">(.*?)<\/t
+d><td align="RIGHT" class="priceValue"><a target="_blank" href="(.*?)
+">(.*?)<\/a><\/td>/gisxm) {
            $hsh->{'url'} = $6;
            $hsh->{'crap_id'} = '';
            $hsh->{'date'} = $1;
            $hsh->{'country'} = $2;
            $hsh->{'destination'} = $3;
            $hsh->{'trip_type'} = $4;
            $hsh->{'trip_length'} = $5;
            $hsh->{'price'}=$7;
            print "$hsh->{'date'}, $hsh->{'country'}, $hsh->{'destinat
+ion'}, $hsh->{'trip_type'}, $hsh->{'trip_length'}, $hsh->{'price'}, $
+hsh->{'crap_id'}, $hsh->{'url'}, $airport\n\n";
        }
    }
}
[download]

The site is developed in asp , so the source contents are not exact HTML format. That's why I am facing lots of problem in fetching data from this site.