I frequently use multi-processing in Perl for the scripts I write at work. I have always used the threads and Threads::Queue module for these scripts. I have been finding references to the many core engine (MCE) online and in the monastery but I'm still not sure when it is best to use MCE or Threads or some other form of multiprocessing.

From what I have gathered, MCE uses the Thread module if it is installed and can also fork processes. Is MCE just a more automated way of implementing multi-processed jobs than explicitly writing code using threads or does it do unique things that threads cannot? I assume that since MCE can use threads to do that multiprocessing voodoo it does so well, that there is not a significant performance penalty for using MCE? It does seem that MCE code is more readable than the equivalent threads code which is already a big plus.

In short, I would love some input on MCE as a whole and how it compares to threads. Would it be good practice to start using MCE instead of threads?

In reply to Wanting some clarification / opinions on MCE vs Threads by jmmitc06

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.