I wrote a couple of scripts a couple of years ago, one for Unix, one for Windows:

• Timing and timing out Unix commands
• Timing Windows commands

to run a command, killing it if it took more than a specified timemout, and reporting how long it took to run.

For Unix, this suggestion by ikegami looks good. What platform are you running on? For Windows, I suggest Win32::Job.