Coro + LWP freezes

elgato has asked for the wisdom of the Perl Monks concerning the following question:

Hi, guys. I try to make async https requests with Coro + Coro::LWP + LWP::UserAgent my code looks like:

my @requests;
while ( ... ) {
    push @requests, ...;

    if (scalar @requests % 3 == 0) {
        &doRequests(\@requests);
    }
}

sub doRequests {
    my $requests = shift;

    my @coro = map {  
        async {
             # here we get LWP::UserAgent object and to request
        }
    } @$requests;
}
[download]

The question is, my code should run all the time, but after running for a few hours or even hour it freezes. No CPU usage, no activity at all, like it's sleeping. This runs perl 5.16.1, latest Core, LWP. I'm wondering how to get know what is the reason for that freeze, how to know where it stopped? PS: i'm querying https host, if that matters. Addon: running strace gives this as last lines berofe freeze:

rt_sigprocmask(SIG_BLOCK, [CHLD], [], 8) = 0
rt_sigaction(SIGCHLD, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
nanosleep({1211417888, 0}, {1211354002, 168413065}) = ? ERESTART_RESTA
+RTBLOCK (To be restarted)
--- SIGWINCH (Window changed) @ 0 (0) ---
restart_syscall(<... resuming interrupted call ...>) = ? ERESTART_REST
+ARTBLOCK (To be restarted)
--- SIGWINCH (Window changed) @ 0 (0) ---
restart_syscall(<... resuming interrupted call ...>
[download]

What does this mean?

Comment on Coro + LWP freezes Select or Download Code

Replies are listed 'Best First'.
Re: Coro + LWP freezes (*trace) by tye (Sage) on Aug 25, 2012 at 21:08 UTC
App::Stacktrace and strace (or truss) - tye	[reply]
Re^2: Coro + LWP freezes (*trace) by elgato (Novice) on Aug 26, 2012 at 07:26 UTC
Here what i get with perl-stacktrace: `root@elgato:/etc# perl-stacktrace 9366 [Thread debugging using libthread_db enabled] 0x00007f7ba19bd500 in __nanosleep_nocancel () at ../sysdeps/unix/sysca +ll-template.S:82 82 ../sysdeps/unix/syscall-template.S: No such file or directory. in ../sysdeps/unix/syscall-template.S /tmp/3c5eHcBTdw.gdb:1761: Error in sourced command file: Cannot access memory at address 0x1` [download] What does that mean?	[reply] [d/l]
Re^3: Coro + LWP freezes (*trace) by tye (Sage) on Aug 26, 2012 at 15:49 UTC
It might be that App::Stacktrace doesn't work with Coro. Or it might just be some other reason it doesn't work in your particular environment. The documentation for App::Stacktrace immediately mentions three options. If one were actually curious about what was going on, every one of those three options looks like something one would try. - tye	[reply]
Re^4: Coro + LWP freezes (*trace) by elgato (Novice) on Aug 27, 2012 at 16:11 UTC
Re: Coro + LWP freezes by Corion (Patriarch) on Aug 25, 2012 at 23:55 UTC
In addition to tye's suggestion, if you reproducibly get a "hung" process, you can try AnyEvent::Debug to look at what parts of it are hung. Of course, if the process gets hung in (say) the SSLeay libraries, it won't serve the AnyEvent::Debug shell either, but if you're maybe deadlocking somewhere, it might help.	[reply]
Re^2: Coro + LWP freezes by elgato (Novice) on Aug 26, 2012 at 07:27 UTC
How would i know it that s SSLeay hanging everything?	[reply]
Re^3: Coro + LWP freezes by Corion (Patriarch) on Aug 26, 2012 at 09:00 UTC
That's just an example. I think it is the most likely candidate for causing trouble if you are actually doing https requests. Maybe you can switch to using http URLs for further diagnosis?	[reply]
Re^4: Coro + LWP freezes by elgato (Novice) on Aug 26, 2012 at 09:05 UTC
Re^5: Coro + LWP freezes by Corion (Patriarch) on Aug 26, 2012 at 09:59 UTC
Re: Coro + LWP freezes by philiprbrenan (Monk) on Aug 25, 2012 at 23:54 UTC
Does @requests ever get emptied?	[reply]
Re^2: Coro + LWP freezes by elgato (Novice) on Aug 26, 2012 at 13:34 UTC
of course, i form @requests array and undef it after requests finished.	[reply]