glwtta has asked for the wisdom of the Perl Monks concerning the following question:

Anyone have experience with SGE or Condor (or both)?

I've been looking for a queuing, load balancing system and those two look like they are the better options available; it'd be great to get a head-to-head comparison.

What I need isn't that fancy - I need to distribute a relatively light load of fairly short (but computationally intensive) user submitted jobs between several machines; as well as the ability to schedule large batches (10-30K jobs) on the same pool, to run with a lower priority than the user jobs, so that those still go through.

Any insight always appreciated.

(PS I suppose this is fairly OT, but the jobs are Perl scripts.)

Replies are listed 'Best First'.
Re: SGE vs Condor?
by RMGir (Prior) on Sep 26, 2003 at 14:56 UTC
    I've never used either.

    I've never HEARD of either.

    But you've piqued my curiosity, so I decided to go out looking for info.

    I'm assuming that this is the Condor you're referring to, and it does look very interesting.

    Is this the SGE you're referring to?

    I obviously can't answer your question, but at least with links, it's easier for the rest of us to follow the discussion.
    --
    Mike

[reply]
Re: SGE vs Condor?
by glwtta (Hermit) on Sep 26, 2003 at 15:53 UTC
    Sorry, didn't realize I was being so obscure.

    Yes, I am referring to Condor High Throughput Computing and the Sun Grid Engine (also sun's site). From what I could gather, these two are the most widely used, at least out of the free ones (I am not quite ready to shell out for LFS). There is also PBS, but apparently the free version is a bit limited and (more importantly) the administration is more involved; also I've come across DQS which I don't know much about.

[reply]

Back to Seekers of Perl Wisdom