Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

Hello Monks,

I seek your wisdom and forgiveness for staying anonymous (but not your wisdom for staying anonymous). Alas Create a new user says it's broken.

I need some kind of job framework for downloading files from a server. The file names of the files to download come over a socket or pipe (I'm not decided yet but I lean towards the pipe because the process currently uses files).

The following features should be supported:

I am oh so tempted to write it myself and I already started (hell, the basic framework isn't even 50 lines) but adding those mentioned features made me think whether I should do this myself and risking a lot of subtle bugs. So I had a look or two at CPAN and found some modules like BatchSystem::SBS or TheSchwartz but they all seem to be very light-weight leaving a lot of work still open.

Is there any solution that comes a bit closer to my desired feature set?

Thanks

Replies are listed 'Best First'.
Re: Looking for a specific job framework
by Your Mother (Archbishop) on Sep 17, 2010 at 02:56 UTC

    I have been semi-satisfied with TheSchwartz but it does do most of what you're asking. The docs aren't hot and you will have to write code to dive the error log etc but it's doable. I don't know if, and I don't think, there is anything better in Perl right now.

Re: Looking for a specific job framework
by Proclus (Beadle) on Sep 17, 2010 at 10:33 UTC
    You still need to add more logic but I would highly recommend using a POE based solution: POE Job Server
      Thanks for your reply. Never heard of POE before. It seems to be quite mature and complex. But even if I end up not using it for my current task, I'll definitely have a look at it.
Re: Looking for a specific job framework
by xiaoyafeng (Deacon) on Sep 17, 2010 at 00:54 UTC
    Do you mean this?




    I am trying to improve my English skills, if you see a mistake please feel free to reply or /msg me a correction

      No, this doesn't have anything to do with the problem at hand. (If it does, I must be absolutely blind.)