in reply to The State of Parallel Computing in perl 2007?

Hi jettero,

I occasioanlly work on "trivially" or "embarassingly" parallelizable problems. For me this most often involves computing a single statistic from a dataset over a large combination of parameters. The most efficient solution for me has been to use R with the Rmpi package to interface with MPI. Depending on the scope of the task, I may also use MySQL for distributing the dataset and collecting the results using RMySQL.

I could see doing the same thing in perl with PDL, Parallel::MPI, and your favorite database.

  • Comment on Re: The State of Parallel Computing in perl 2007?

Replies are listed 'Best First'.
Re^2: The State of Parallel Computing in perl 2007?
by jettero (Monsignor) on Jan 22, 2007 at 19:29 UTC
    I clicked through to ::MPI a little, but the low version number and update from 1999 kinda scare me off. I have looked at PDL enough to wish I had columns of numbers to process.

    -Paul

      I initially had to choose between PVM and MPI, and I ended up using MPI only because that was the first thing I tried and it happened to work for me. From what I had read at the time, PVM should work just as well as MPI for trivially parallelizable tasks. I would not guess that the MPI module is so trivial that it did not warrant any changes, but it does look like the PVM module has seen more development activity.