In the spirit of parallelism, MCE provides a generator for sequence of numbers which is beneficial for parallelizing the outer loop. The Sereal module is requested if available. Otherwise, freeze and thaw are provided by the Storable module. The Sereal module is ~ 2x faster for large data and likely helpful after completing audacious actions with @queue possibly saved into @ret.

I'm not sure what is needed once the @queue reaches $qsize. Thus, added @ret.

The non-parallel code (by Karl) takes 8.647 seconds with the parallel code completing in 2.418 seconds.

use MCE::Flow Sereal => 1;
use Time::HiRes qw(time);

my $start = time;
my @queue;
my @line;

# same ratio - i guess 20 MP
my $width  = 1280 * 4;
my $height = 1024 * 4;
my $qsize  = 32;

# The bounds_only option applies to sequence of numbers
# which means to compute the begin and end boundaries only,
# not the numbers in between. Thus, workers receive 2
# numbers in @{ $chunk_ref }.

MCE::Flow::init(
   max_workers => 'auto',
   chunk_size  => 16,
   bounds_only => 1,
   gather      => sub {
      my (@ret) = @_;
   }
);

# Same as mce_flow_s sub { ... }, 0, $width - 1;

MCE::Flow::run_seq( sub {
   my ($mce, $chunk_ref, $chunk_id) = @_;
   for my $x ( $chunk_ref->[0] .. $chunk_ref->[1] ) {
      for my $y ( 0 .. $height - 1 ) {
         my $coords = [ $x, $y ];
         push @line, $coords;
         if ( scalar @line == $width ) {
            push @queue, [@line];
            @line = ();
            # audacious actions start here
            if ( scalar @queue == $qsize ) {
               my @ret; # save output to @ret ??
               # dd \@queue;
               MCE->gather(@ret);
               @queue = ();
            }
         }
      }
   }
}, 0, $width - 1 );

printf "Took %.3f seconds\n", time - $start;

[download]

In reply to Re: Threads From Hell #3: Missing Some Basic Prerequisites by marioroy
in thread Threads From Hell #3: Missing Some Basic Prerequisites [Solved] by karlgoethebier

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.