$request->as_string() returns the request, headers and all. However, it needs to be called AFTER the UserAgent adds its headers. You can force UserAgent to add its headers by calling the UserAgent's prepare_request. To avoid calling prepare_request a second time, substitute a call to the UserAgent's send_request method for the call to the its request method.

In other words, replace

$response = $ua->request($request);
[download]

with

$ua->prepare_request($request);
print($request->as_string);
# $response = $ua->send_request($request);
[download]

Uncomment the commented line if you want to both log and send the request.

Similarly, get is just a shortcut to return a request object and passing it to the UserAgent's request method.

$response = $ua->get($url);
[download]

is the same thing as

$request = HTTP::Request::Common::GET($url);
$response = $ua->request($request);
[download]

so replace it with

$request = HTTP::Request::Common::GET($url);
$ua->prepare_request($request);
print($request->as_string);
# $response = $ua->send_request($request);
[download]

sometimes, it's hard to mimic the request on the first try when remote use js,cookie,user-agent checking etc.

inspect the difference between sending request through browser and through LWP, then fill the difference in your perl script and try again.

oh, i found the headers_as_string is handy too. it ruturns the response header as string which may be suffice for you to check the return header. an example i use is to extract the url out of meta refresh from the response header (LWP only follow http 301,302,303,307 redirect)

     use LWP;
     my $br = LWP::UserAgent->new;
     my $resp = $br ->get('http://www.pulse24.com'); 
     print $resp->headers_as_string";
__END__
     Client-Peer: 207.61.136.40:80
     Client-Response-Num: 1
     REFRESH: 0;URL=http://www.pulse24.com/Front_Page/page.asp
     X-Meta-Robots: noindex
     X-Powered-By: ASP.NET
[download]

It's not a perl answer, but sometimes when troubleshooting it's good to just sniff the connection. There are plenty of free network sniffers out there, provided wherever you work doesn't have a policy against using them.

(use your favorite search engine to find one for your platform)

To see all headers and values, use HTTP::Header's scan() method.

#!/usr/bin/perl 
use strict;
use LWP::UserAgent;
my  $agent = LWP::UserAgent->new;
my  $headers = HTTP::Headers->new('User_Agent' => 'Cyberdog/5.0',
                              'Accept' => 'image/gif, 
                               image/x-xbitmap,
                               image/png,
                               image/jpeg,
                               */*',
                               'Accept-Charset' => 'iso-8859-1',
                               'Accept-Language' => 'en-US');

#headers before the request:
    $headers->scan(\&printheaders);
 my $response = $agent -> get('http://localhost', $headers);
#and after: 
    $response->scan(\&printheaders);

sub printheaders() {
    my $h = shift;
    my $v = shift;
    print ("Header: $h \t Value:$v\n");
}
[download]

No, that's not right. Your method is not guaranteed to print all the headers. You're listing the headers too soon. For example, if you stopped overridding User-Agent, your method wouldn't list all the headers. See my post above for an explanation of why.