in reply to Parallel batch process plumbing issues

Maybe make each job write a file when it is finished and watch the directory for all desired file to be there ?

There is also Schedule::SGE but it is in version 0.02 ...

  • Comment on Re: Parallel batch process plumbing issues

Replies are listed 'Best First'.
Re^2: Parallel batch process plumbing issues
by gmol (Sexton) on Dec 22, 2005 at 23:16 UTC
    Well ok, I think I have a simple solution. Just make a sub script that calls the binary, and writes to a file when it's done, checks to see if it's the last one to chip into the output pool, and if it is, exec the parent script again. A little ugly, but not kludgy enough to make me shudder... Sounds good, but I'll need to be careful about atomicity in checking/writing to files...any pointers would be apprecaited.
      Ah ok O'Riley Perl cookbook chap 7.11. I think my problem is solved.