in reply to Re: AnyEvent Parallel HTTP
in thread AnyEvent Parallel HTTP
Uh - AnyEvent is a framework to do tasks in parallel that are not CPU bound. And usually, web scraping is not CPU bound. Distributing the load across more than one CPU makes sense if your load is CPU bound, but not necessarily when scraping a website over the network.
There is no need to involve threads or forking when using AnyEvent.
|
|---|