As I mentioned, it's a little tricky to post code since the errors are so random. I will provide an example that just cropped up. The system is a multi-way linux box.

my $cmd = ". $basedir/testEnv.txt; . stp_include.sh && ./wrap.sh $scri
+pt_param &> ../logs/run-log.txt";
syslog "Executing test with command $cmd";
syslog `$cmd`;
$ret = -1 unless ( $? == 0 );
print "Done executing";
[download]

This code block executes a wrapper script that calls other executables. These executables can take hours to run. Just now I had a run of this where the wrapper finished (the run-log shows it running to completion). However, I don't see either the following print nor the one after the call to this function. This suggests it died soemtime around the exit of the wrap.sh file.

I am now watching the execution and I see that the parent script (the one that contains the above code) exits while the child (wrap.sh) runs. Doing a ps shows the wrap.sh running but no parent. Any ideas about how to troubleshoot?. As I said these problems are not easily reproducable so the next time I run this same code (which I will later today) it may run well or not.