in reply to Re^2: Reading and writting data in a text file with several scripts simultaneously time synchronization problem
in thread Reading and writting data in a text file with several scripts simultaneously time synchronization problem

I would go with the database if that is desirable since it might well make future reporting easier to manage. But you could always use the Benchmark module to test out different methods.

As for flock and INI files, I presume you mean a typical foo.ini file for config variables. I don't see why you would have any conflicts unless the file is remote mounted over a network. Some versions of flock might have problems with that. YMMV.

The main issue is to devise a decent semaphore scheme that removes any dependence upon sleep() to synchronize the various parts other than establishing a timing loop for polling the semaphore.

It helps to remember that the primary goal is to drain the swamp even when you are hip-deep in alligators.
  • Comment on Re^3: Reading and writting data in a text file with several scripts simultaneously time synchronization problem
  • Select or Download Code

Replies are listed 'Best First'.
Re^4: Reading and writting data in a text file with several scripts simultaneously time synchronization problem
by thanos1983 (Parson) on May 19, 2014 at 22:19 UTC

    To: boftx

    Perfect Benchmark is exactly what I need. I am thinking of applying a few different solutions and where I can get. I am afraid the time grows as the file grows. But the flock comes in handy there.

    Well the reason that I was avoiding to use DB, is that I was trying to make my code a bit more generic and I am not 100% sure yet if on my final task I will be able to apply DB.

    The whole story is that I am creating a main test script that I need to produce random data and store them into a file for simplicity. The secondary scripts I want them to retrieve the data process them and also store their output on separate files, for comparison reasons after. I want to compare how many data where able to process and how fast!

    In conclusion even the secondary scripts are test scripts I will chose only one of them to apply on my real goal. I am testing them to see performance under pressure in order to choose the best one.

    This is the reason that either I need to store the data to a folder for later retrieving them or into a database. The problem is also that on my real goal several scripts will need to access this folder to retrieve the data.

    So I am trying to make my experiments as realistic as possible.

    So enough said, time for coding. I need first of all to compare the times. Initially with the folders in different formations and possible create a short script with MySQL also just to observe if there is a huge difference on process time.

    P.S. Sorry for the long answer I tried to include everything.

[reply]

In Section Seekers of Perl Wisdom