Danikar has asked for the wisdom of the Perl Monks concerning the following question:

Is there a way to use LWP:Simple to get the source of an XML document without the XSL transformation. Whenever I use get() it gives me the HTML / Javascript output after the XML has been transformed, but if I got to the site and hit view source I can see the XML with no problem. I am sure I am just being dumb and can not find the option, but I have looked =( I must be just missing it.

Replies are listed 'Best First'.
Re: Get non transformed XML
by erroneousBollock (Curate) on Nov 22, 2007 at 08:49 UTC
    Is there a way to use LWP:Simple to get the source of an XML document without the XSL transformation.
    I doubt LWP::Simple has anything to do with XSL translation of some XML document loaded by a webserver.

    if I got to the site and hit view source I can see the XML with no problem
    My intuition is that the webserver is detecting the browser "agent" string and has determined that your browser (LWP::Simple) can't apply the stylesheet itself, so the webserver is doing the translation server-side for you.

    Try using LWP::UserAgent and:

    $ua->agent('Mozilla/5.0');

    $ua->agent('Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/2006120418 Firefox/2.0.0.1');

    Update: fixed agent string, thanks Gangabass.

    -David

[reply]
[d/l]
[select]
      I just tried the code below and recieved the same thing =( 
      require LWP::UserAgent;

my $ua = LWP::UserAgent->new;
$ua->timeout(10);
$ua->env_proxy;
$ua->agent('Mozilla/5.0');

my $response = $ua->get('http://www.wowarmory.com/');

if ($response->is_success) 
{
	print $response->content;  # or whatever
}
else 
{
	die $response->status_line;
}
[reply]

        I think this not enough.

        Try this UserAgent:

        $ua->agent('Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1
+) Gecko/2006120418 Firefox/2.0.0.1');

        [download]

        If this not help when try UserAgent which your browser send to target site (you can see it with HTTP::Proxy).

[reply]
[d/l]
        Firefox DownThemAll addon retrieves 183 bytes.
        wget retrievies 23k.

        I think it's safe to say it's some sort of header :-)

        Update: fixed in first reply.

        -David

[reply]
[d/l]

Back to Seekers of Perl Wisdom