Not really perl related, but we've had great
success with
openpbs, aka
"Open Portable Batch Scheduler".
- open source
- provides a tcl ( I know, I know )
interface where you can even write your own scheduler
- stdout/stderr watching, as you mentioned
- an open api for reporting status back
- dependency chain ( only run job b if job a succeeds,
etc)
I am only using it for running sql batch jobs, as
I needed the job dependency chains. Would have
gotten by with cron otherwise. So, since I'm not
using it like you would, I'm not sure if it covers
your other needs. I will note that it expects to
run scripts, and not binaries ( it reads the script
into stdin for later feeding to whatever is on the
shebang line ). You would have to create wrapper scripts
for your render jobs...
Here's the blurb from their website:
The Portable Batch System (PBS) is a flexible batch queueing and workload management system originally developed for NASA. It operates on networked, multi-platform UNIX environments, including heterogeneous clusters of workstations, supercomputers, and massively parallel systems. Development of PBS is provided by Altair Grid Technologies.
Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
Read Where should I post X? if you're not absolutely sure you're posting in the right place.
Please read these before you post! —
Posts may use any of the Perl Monks Approved HTML tags:
- a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
| |
For: |
|
Use: |
| & | | & |
| < | | < |
| > | | > |
| [ | | [ |
| ] | | ] |
Link using PerlMonks shortcuts! What shortcuts can I use for linking?
See Writeup Formatting Tips and other pages linked from there for more info.