I found another solution after reading through the Unix Socket FAQ. At the beginning of the loop I do:

my $error_code = $socket->sockopt(SO_ERROR);
[download]

On FreeBSD this returns a value other than zero if there has been an error on the socket, so I am able to trap that and exit gracefully if an error occurs on the socket.