fetching a gzipped website

Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

Hi there!
I wish to fetch the following webpage:

http://en.wiktionary.org/wiki/baby

But it is gzipped. How can I fetch this page so that I can parse it?
Thanks!

Comment on fetching a gzipped website

Replies are listed 'Best First'.
Re: fetching a gzipped website by Corion (Patriarch) on May 26, 2010 at 17:45 UTC
Use WWW::Mechanize. It will honor the `Transfer-Encoding` headers.	[reply] [d/l]
Re: fetching a gzipped website by ikegami (Patriarch) on May 26, 2010 at 18:39 UTC
If you used LWP, you used `->content` instead of `->decoded_content`. You should never use the former unless you call `->decode` first.	[reply] [d/l] [select]