Getting back to Parallel::ForkManager, which you attempted to use in your first post, you might want to try 

use Parallel::ForkManager;

my $fm1 = new Parallel::ForkManager(5);

for my $val1 (1..10) {
    
    $fm1->start and next;

    # $0 = "processing step 1: $val1";  sleep 10;
    
    open FILE, ">", "$val1.txt" or die $!;
    print FILE "Output of step 1\n";
    close FILE;

    my $fm2 = new Parallel::ForkManager(2);
    
    for my $val2 (qw/a b/) {

        $fm2->start and next;

        # $0 = "processing step 2: $val1/$val2";  sleep 5;

        open FILE1, "<", "$val1.txt" or die $!;
        open FILE2, ">", "$val2$val1.txt" or die $!;
        while (my $line = <FILE1>) {
            $line =~ s/1/2/;
            print FILE2 $line . "\n";
        }
        close FILE1;
        close FILE2;
        
        $fm2->finish;
    }
    
    $fm1->finish;
}

[download]

This would run max 5 processes at the outer level, plus max 2*5 at the inner level, i.e. max 15 processes total (10 inner from the last round + 5 outer for the next round).  I'm not entirely sure that's what you want, but it's at least something to play with...

P.S. If you uncomment the $0 = ... lines, you can grep for "processing" in the ps output to observe what's going on.

In reply to Re: Help with multiple forks by Eliya
in thread Help with multiple forks by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.