My notes recommend something like this (assuming Connection is your socket descriptor?):

use Fcntl;
fcntl(Connection, F_SETFL, O_NONBLOCK) 
    or die "can't set non blocking: $!";
[download]

I suppose you could also wrap your Socket->accept() in alarm() calls....