I've noticed similar problems in the perl test suite when building perl on *some* platforms. See this post on perl5-porters, which never got a response.

To summarise: possible bug in perl or OS bug, work-around it by inserting a micro-sleep using four-arg select() in your loop.