in reply to running multiple LWP gets

Just a lateral thinking kind of suggestion: Ask the customer if they can give you a copy of the content directly rather than you walking their site. Aside from side stepping the problem of what to use, that also avoids any bottlenecks you'd run into by attempting to pull content faster than their boxen could provide it.

And POE's not an elephant-gun approach, it's just a event-based wrapper around a traditional *NIX select-y approach. It can take a little getting into the mindset, but once that's done POE's pretty cool.

Replies are listed 'Best First'.
Re^2: running multiple LWP gets
by gferguson (Acolyte) on May 25, 2007 at 18:52 UTC
    Well... I did ask for content. Several times. And, as it usually goes in corporate 'Merica, some gatekeeper between me and them thought the badly mangled and truncated content I was receiving was good enough. Of course I wouldn't have been given the task if their solution had been working. :-)

    I'll look into POE and its examples some more. It seems really useful for other tasks we've got, just overkill for this particular one. My inexperience with it could be coloring my vision though.

    Thanks!

[reply]

In Section Seekers of Perl Wisdom