Implementing a queue based system

chanakya has asked for the wisdom of the Perl Monks concerning the following question:

Replies are listed 'Best First'.
Re: Implementing a queue based system by Corion (Patriarch) on Mar 23, 2005 at 09:10 UTC
What you get by MQSeries is a whole infrastructure and safe distribution and delivery of messages. If you don't already have an MQSeries infrastructure set up, then MQSeries::Queue will be of no use to you. One convenient mechanism of message passing via store-and-forward is SMTP, which already has a big supporting infrastructure set up, another convenient mechanism might be a file system scheme like the following: `incoming/ arrived/ processing/ processed/` [download] Files get written into the `incoming` directory, and moved into the `arrived` directory once they have arrived completely. The importing application moves a file into the `processing` directory and then starts working on the file. After the file has been processed, it is moved into the `processed` directory. This setup makes monitoring the whole process quite convenient, as no file may be in any directory other than `processed` for longer than five minutes (or so). The SOAP::Lite modules also implement a message transport over various media. But as you don't state what your requirements for the message transport are, there really is no way of telling what might be suitable to your needs.	[reply] [d/l]
Re^2: Implementing a queue based system by chanakya (Friar) on Mar 23, 2005 at 13:32 UTC
Corion Than you for the reply. The requirement is simple, SOAP::Lite server will accept a SOAP message from the client and put it in a queue. Another script will check if the queue/folder is not empty, pick the message, parse it and update the database. Do you think any CPAN module will help me in achieving this setup Thanks	[reply]
Re: Implementing a queue based system by TilRMan (Friar) on Mar 23, 2005 at 13:53 UTC
Take a look at IPC::DirQueue. I've never used it, but it looks like it should do the trick.	[reply]
Re^2: Implementing a queue based system by chanakya (Friar) on Mar 24, 2005 at 05:29 UTC
Thank you everyone for the suggestions. I've took a look at IPC::DirQueue and it looks impressive. Thanks TilRMan	[reply]
Re: Implementing a queue based system by gellyfish (Monsignor) on Mar 23, 2005 at 13:47 UTC
You might want to consider using D-Bus which is a message queuing system and the as yet unreleased Perl API - I'm sure if people started using it the guy will release to CPAN. /J\	[reply]
Re: Implementing a queue based system by perlfan (Parson) on Mar 23, 2005 at 18:03 UTC
It sounds like your queue needs are pretty simple. You could simply use an array to push/shift entries off - FIFO style. You could even use DBM::Deep for some persistence.	[reply]