Re^2: When to use forks, when to use threads ...?

Ah... I just posted a node about Perl releasing memory back to the system when using threads... see OS memory reclamation with threads on linux From my previous experimentation, it was almost certain that Perl would hold onto the memory, but that may have been because I was testing at a "sweet spot" where Perl's calculations of free memory-vs-it's use allowed it to retain the memory. But when it is very high mem usage, Perl will release it. It's a crap shoot, and may depend on Perl versions, thread versions, and even the kernel.

But the gist is, Perl will release large memory chunks if it's in a thread. And the c guru said that top and ps cannot always be trusted as an accurate measure of mem use. So I would ask, as your memory climbed, did the system slowdown, or did things keep running normally.

I'm not really a human, but I play one on earth Remember How Lucky You Are

Comment on Re^2: When to use forks, when to use threads ...?

Replies are listed 'Best First'.
Re^3: When to use forks, when to use threads ...? by Krambambuli (Curate) on Sep 05, 2008 at 08:16 UTC
So I would ask, as your memory climbed, did the system slowdown, or did things keep running normally. I watched the RES column from ps's output, first via top, then also using a code snippet taken out from Process::MaxSize like `[...] my $size; open PIPE, "/bin/ps wwaxo 'pid,rss' \|"; while(<PIPE>) { next unless /^\s*$$\s/; s/^\s+//g; chomp; $size = (split(' ', $_))[1]; } close PIPE; return $size; }` [download] I didn't wait to let the system really slowdown, but stopped when it became obvious that swapping would have to start. Krambambuli ---	[reply] [d/l]

Replies are listed 'Best First'.

Re^3: When to use forks, when to use threads ...?
by Krambambuli (Curate) on Sep 05, 2008 at 08:16 UTC

So I would ask, as your memory climbed, did the system slowdown, or did things keep running normally.

Process::MaxSize

[...]
    my $size;

    open PIPE, "/bin/ps wwaxo 'pid,rss' |";
    while(<PIPE>) {
        next unless /^\s*$$\s/;
    s/^\s+//g;
        chomp;
        $size = (split(' ', $_))[1];
    }
    close PIPE;

    return $size;
}
[download]

Krambambuli
---

[reply]
[d/l]