If you are not tied to the idea of having Perl handling the actual inter process communication, there may another option that might prove useful: openMosix. Here's some text from the web site that best describes what it does:

"…openMosix is a Linux kernel extension for single-system image clustering. This kernel extension turns a network of ordinary IA-32 computers into a supercomputer for Linux applications…."

"…There is no need to program applications specifically for openMosix. Since all openMosix extensions are inside the kernel, every Linux application automatically and transparently benefits from the distributed computing concept of openMosix. The cluster behaves much as does a Symmetric Multi-Processor, but this solution scales to well over a thousand nodes which can themselves be SMPs."

In theory, all you need to do is write your Perl code so that it forks off a process to do the number crunching and then return the data when it finishes, the kernel patch will take care of locating and moving the thread to an available machine for you. Processing nodes can be added or removed from a cluster without requiring effecting running processes (other than speed). The only down side to this is that this only works with Intel compatible processors and Linux, so this can't be run on a Sun box. However, it is FREE, and may be able to improve the performance of your existing Perl code with little or no modification.

More info can be found on the web site here: http://openmosix.sourceforge.net/

Rick

In reply to Re: Clustered Perl Applications? by scrubroot
in thread Clustered Perl Applications? by sri

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.