Re: Synchronizing multiple processes retrieving files out of shared directory

Well, if to rediscover the wheel:
write the 5th perl process for managing file names
and let that process
to give those names away to the processes of yours at request?
I'm not sure.
They can talk with each other via simple socket.
Maybe some database table will do the trick?
Sorry if these suggestions offended anyone.

Comment on Re: Synchronizing multiple processes retrieving files out of shared directory

Replies are listed 'Best First'.
Re^2: Synchronizing multiple processes retrieving files out of shared directory by MitchInOmaha (Initiate) on Mar 20, 2014 at 13:05 UTC
Part of our goals is to have as much redundancy as possible and to avoid having any single process that could impact the operation of the others. Having a single process that each of these worker bees have to check in with creates the risk of a single point of failure. I'm going to do some testing with creating lock files that have exclusive locks on them, so a competing process can't create a lock file of the same name, preventing them from processing the same file elsewhere.	[reply]

Replies are listed 'Best First'.

Re^2: Synchronizing multiple processes retrieving files out of shared directory
by MitchInOmaha (Initiate) on Mar 20, 2014 at 13:05 UTC

Having a single process that each of these worker bees have to check in with creates the risk of a single point of failure.

I'm going to do some testing with creating lock files that have exclusive locks on them, so a competing process can't create a lock file of the same name, preventing them from processing the same file elsewhere.

[reply]