If anywhere, this is where an ECHILD would make more sense.

Such a statement only makes sense if $! is scoped to be different between your signal handler and your main loop. They are both in the same process. $! is global to the process. And signals handlers get run asynchronously compared to the main program flow.

Add local($!); to your signal handler.