Good day bros. I am trying to learn how to use threads in Perl to apply it in a script that is doing calculations on a large graph. I know I need to limit the number of threads I spawn, so I've been reading up and have demo code working that limits the number of threads with semaphore and works as expected.
#!/usr/bin/perl -w use strict; use threads; use Thread::Semaphore; my $sem = Thread::Semaphore->new(15); # max 15 threads my @threads; for my $i (0..5) { $sem->down; my $t = threads->create(\&mySubName, $i); push(@threads,$t); } foreach my $t (@threads) { print $t->join(),"\n"; } sub mySubName { my $foo = shift(@_); return $foo * 10; # release slot: $sem->up; }
However I have a question about the @threads array. Since that exists till then end of the loop, do the thread objects it contains only hold the values returned by the sub, or do they have other data that would eat a lot of memory? If so then the approach I have here won't work for processing all pairs of nodes in a 7000 node graph.

Assuming that's the case I tried this

##!/usr/bin/perl -w use strict; use threads; use threads::shared; use Thread::Semaphore; my $sem = Thread::Semaphore->new(15); # max 15 threads my @results :shared = 1; for my $i (0..5) { $sem->down; my $t = threads->create(\&mySubName, $i); } print join(" ",@results); sub mySubName { threads->detach(); my $foo = shift(@_); push (@results,$foo); $sem->up; }
but the output is 1 0 1 2 3 which is not right.

Guidance appreciated.


In reply to Threading and join/termination question by cormanaz

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.