I'm using Lwp::useragent and Mechanize for getting source page of websites but for this website(https://camelcamelcamel.com/) when runs the code it shows 500 error. I can't able to figure out where is my mistake. I don't know whether my mistake in cookie or useragent, can someone help me with this using Lwp::useragent itself...Thank you in Advance. 

use strict;
use LWP::UserAgent;
use HTTP::Cookies;
my $url = "https://camelcamelcamel.com/";
my $ua=LWP::UserAgent->new();
$ua->agent("Mozilla/5.0 (Windows NT 6.1; WOW64; rv:46.0) Gecko/2010010
+1 Firefox/46.0");
my $cookie = HTTP::Cookies->new(file=>$0."_cookie.txt",autosave=>1);
$ua->cookie_jar($cookie);
my $req = HTTP::Request->new(GET=>"$url");
$req->header("Content-Type"=> "application/x-www-form-urlencoded");
$req->header("Accept"=> "text/html,application/xhtml+xml,application/x
+ml;q=0.8,*/*;q=0.7");
my $res = $ua->request($req);    
$cookie->extract_cookies($res);
$cookie->save;
$cookie->add_cookie_header($req);
$res->header("Content-Type"=> "application/xml; charset=utf-8");
my $code=$res->code;
print "Code::$code\n";

[download]

In reply to Can't able to get source page 500 error. by sugu

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.