Re^5: LWP not returning leading spaces in web page (ver 2)

You want the gzip related methods of Compress::Zlib rather than inflate. The most direct method would be:

use LWP;
use Compress::Zlib;

my $ua = new LWP::UserAgent;
my $request = HTTP::Request->new('GET', 'http://groups.yahoo.com/');
$request->headers->header(
   accept_encoding => 'x-gzip, gzip, identity',
   user_agent => 'Mozilla/5.0 (compatible; Konqueror/3; Linux)',    
);
my $r = $ua->request($request);
my $gzipped_content = $r->content;
print Compress::Zlib::memGunzip($gzipped_content);
[download]

Comment on Re^5: LWP not returning leading spaces in web page (ver 2) Download Code

Replies are listed 'Best First'.
Re: ^6 LWP not returning leading spaces in web page (ver 2) by aspen (Sexton) on Feb 03, 2003 at 00:41 UTC
adrianh, I really owe you a thank you! The final solution was a combination of requesting Groups.yahoo.com to return the page as gzip compressed, followed by your reference to the correct zlib call. Thanks again to all. I AM now retrieving the originally desired pages, containing SMTP headers, with the desired leading spaces. Apache was stripping out the leading spaces when retrieving pages in uncompressed format. Reading some of the apache documentation, it appears this is something called "light compression". I did not find a header string that would turn this off (except through requesting gzip encoding). Andy `@_="the journeyman larry disciple keeps learning\n"=~/(.)/gs, print(map$_[$_-77],unpack(q=c*=,q@QSdM[]uRMNV^[ni_\[N]eki^y@))` [download]	[reply] [d/l]

Replies are listed 'Best First'.

Re: ^6 LWP not returning leading spaces in web page (ver 2)
by aspen (Sexton) on Feb 03, 2003 at 00:41 UTC

adrianh

thank you!

The final solution was a combination of requesting Groups.yahoo.com to return the page as gzip compressed, followed by your reference to the correct zlib call.

Thanks again to all. I AM now retrieving the originally desired pages, containing SMTP headers, with the desired leading spaces.

Apache was stripping out the leading spaces when retrieving pages in uncompressed format. Reading some of the apache documentation, it appears this is something called "light compression". I did not find a header string that would turn this off (except through requesting gzip encoding).

Andy

@_="the journeyman larry disciple keeps learning\n"=~/(.)/gs,
print(map$_[$_-77],unpack(q=c*=,q@QSdM[]uRMNV^[ni_\[N]eki^y@))
[download]

[reply]
[d/l]