in reply to Re: Problem with LWP::UserAgent
in thread Problem with LWP::UserAgent
For example https://www.7digital.com/
By further investigation I discover that some webs send pages compressed by gzip and at least all of those make Perl crash. Don't know if I can somehow enable the support by any additional header attribute, what I tried doesn't work so far - HTTP::Headers->header('Accept-Encoding' => 'gzip')
There may be also problem with expired SSL certificate not handling by LWP::UserAgent->request()
In the meantime I'm fetching this web externally by cURL, but I'm not too comfortable with this as the content seems not parsed well. In any case I would prefer retrieving the web pages internally via Perl's module
Alternately I would accept a suggestion to different more robust Perl's framework for fetching pages
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^3: Problem with LWP::UserAgent
by holli (Abbot) on Jun 23, 2019 at 12:26 UTC | |
by Paradigma (Novice) on Jun 23, 2019 at 20:31 UTC | |
by holli (Abbot) on Jun 23, 2019 at 20:55 UTC | |
by Paradigma (Novice) on Jun 24, 2019 at 11:25 UTC | |
by holli (Abbot) on Jun 25, 2019 at 05:49 UTC |