I've been overtasking for years and have learned the power of using a cron brain, a looped perl socket-server (for task dispatcher), and a bunch of child nodes waiting for microtasks. The child nodes are spread across your cluster.
In my grossly anti-knowledged opinion, it is identical to the fancy Message Maping Protocal Beowolf clusters rely on.
Cept you'd have to set your cluster preferences yourself.
Sockets rock! You can define your own protocals for speed and memory management. My only beef with them is killing them can get tricky. But only b/c i'm green.
hope dis helps,
Snippets of code should be wrapped in
<code> tags not<pre> tags. In fact, <pre>
tags should generally be avoided. If they must
be used, extreme care should be
taken to ensure that their contents do not
have long lines (<70 chars), in order to prevent
horizontal scrolling (and possible janitor
intervention).