Hello 1nickt,

The gather option must be set each time when running MCE inside a loop. In that case, it's easier to use MCE::Flow instead which allows one to pass a hash containing MCE options for the job.

use strict; use warnings; use feature 'say';
use Data::Dumper; ++$Data::Dumper::Sortkeys;

use MCE::Flow;
use MCE::Candy;

my $aref = [];

MCE::Flow::init(
    max_workers => 4,
    chunk_size  => 1,
);

for ( 0, 1 ) {
    say "Test $_";
    mce_flow {
        gather => MCE::Candy::out_iter_array( $aref )
    },
    sub {
        my ( $mce, $chunk_ref, $chunk_id ) = @_;
      # warn "chunk_ref " . Dumper $chunk_ref;
        my ($chunk) = @{ $chunk_ref };
      # warn "chunk " . Dumper $chunk;

        MCE->gather( $chunk_id, $chunk->{'foo'} );
    },
    get_data( $_ );

    say "$_ : " . Dumper $aref;
    $aref = [];
}

sub get_data {
    my $which = shift;
    if ( $which == 1 ) {
        return [
            { foo => 'bar', baz => 'qux' }
        ];
    } else {
        return [
            { foo => 'bar', baz => 'qux' },
            { foo => 'qux', baz => 'bar' },
        ];
    }
}

[download]

Output

Test 0
0 : $VAR1 = [
          'bar',
          'qux'
        ];

Test 1
1 : $VAR1 = [
          'bar'
        ];

[download]

Regards, Mario.

Update:

When gathering data and running inside a loop, it's important to specify the gather option each time. MCE::Candy::out_iter_array($aref) returns a closure block contaning a lexical order_id variable starting at 1. Basically, order_id correlates to chunk_id. Out of order items are held temporarily.

sub out_iter_array {

   my $_aref = shift; my %_tmp; my $_order_id = 1;

   _croak("The argument to \"out_iter_array\" is not an array ref.")
      unless ( ref $_aref eq 'ARRAY' );

   return sub {
      my $_chunk_id = shift;

      if ( $_chunk_id == $_order_id && keys %_tmp == 0 ) {
         # already orderly
         $_order_id++; push @{ $_aref }, @_;
      }
      else {
         # hold temporarily otherwise until orderly
         @{ $_tmp{ $_chunk_id } } = @_;

         while ( 1 ) {
            last unless exists $_tmp{ $_order_id };
            push @{ $_aref }, @{ delete $_tmp{ $_order_id++ } };
         }
      }
   };
}

[download]

In reply to Re^3: MCE::Loop with only one element in list by marioroy
in thread MCE::Loop with only one element in list by 1nickt

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.