Re: Re: When starting a process, at what point does "open()" return?

Thanks for your response. My apologies for the lack of completeness of my post. I was trying to pose a more general question, rather than focus on the specifics of my situation. In response to your queries:

And you're using a flakey executable because...?

From bitter experience, I would say that complex software projects tend to require moderately complex tools to test some aspects of them. The unfortunate part is that it is rare to find the same effort put into testing tools as it is into the original project.

I am currently on a short term contract (6 weeks total), in which I have not had the opportunity to spend the time debugging their test executables. I have access to the scripts, and I do what I can.

What makes you sure that you're getting stuck in the open statement? (Showing us some code around the open statement might help.)

The following code is a cut from the script:

        open(STDOUT, "> $l_cqr_std_output_dir\\cqr_out_$l_counter_x.tx
+t");
        $l_proc_id = open ($handleName, "| $command ");
        print STDOUT "CQRD Process ID: [".$l_proc_id."]\n";
[download]

The results when it fails (which is only fairly occasionally) is that the output log file created by the first line is created, but the print line is never executed, and the script hangs. If you find the rogue process created by the open command and terminate it using the Task Manager, the script recovers, and the output log file shows the process ID of the CQRD that you just terminated.

or that you are trying to run 30 instances of the same piece of crap

Bingo.

Don't some OS's have a problem with opening too many file handles?

It seems to work fine unless the errant process has a problem on startup. While I can't completely discount the possibility that Windows is jamming its head firmly into something unholy, I think it's unlikely this time.

Cheers
Mike

Comment on Re: Re: When starting a process, at what point does "open()" return? Select or Download Code

Replies are listed 'Best First'.
Re: Re: Re: When starting a process, at what point does "open()" return? by graff (Chancellor) on Aug 21, 2003 at 01:01 UTC
Ah. This makes it very clear. Thanks (and ++!!) So, while I don't understand what could cause the behavior that you observe (let's hope someone else looks more closely at this thread and can explain it), there might be some way to write another perl script that automates the recovery procedure you've been doing manually -- but I'm only guessing, because my exposure to process-control details on windows is nil. But consider... if you make the outputs to the log file "atomic" (add the extra overhead to open/write/close each time you append a message to the log, so some other process has a chance to read it while this test script is running), you might be able to run a separate script that loops on "check the log file; sleep". Make sure the problem script (which is trying to launch the flakey executable) logs when it's about to start a process (including the iteration number or some other distinct id), as well as when the open call returns. Now, the separate monitor script could figure out when the problem script is hanging; it knows the pids of the jobs that have been opened successfully (they're in the log file), and now it just needs to find a pid in the windows process table that is associated with the flakey executable, but isn't in the log file. The monitor script kills that "outlier" pid (could even append to the log file to report that), and the problem/test script would move on. As I said, I'm only guessing that something like this would work -- I don't know how you would actually implement it. And of course it doesn't really answer you initial question or solve the real problem. But if it works as intended, you could at least move on towards whatever your "true" objective may be.	[reply]
Re: Re: Re: Re: When starting a process, at what point does "open()" return? by tid (Beadle) on Aug 22, 2003 at 02:18 UTC
I'd started down that path, and only gotten to the point of timing out the log files created by the test EXEs when they start correctly. But I hadn't thought to search through the task list and match to two up. Worth a shot! Many Thanks! Mike	[reply]