Re: help with writing a web crawler with LWP

Try instead to write a web crawler with Mojo::Useragent, it is much more flexible and easy.

Comment on Re: help with writing a web crawler with LWP Download Code

Replies are listed 'Best First'.
Re^2: help with writing a web crawler with LWP by Anonymous Monk on Sep 10, 2018 at 15:48 UTC
In fact there is a role for Mojo::UserAgent designed for this use case: Mojo::UserAgent::Role::Queued	[reply]