Your handle is a socket, so you should use recv to read from it. Rather than polling the handle, try four-arg select to allow sleep between reads. For sockets you can even do that on winders.

You can simplify usage with IO::Socket and IO::Select. It's a worthwhile exercise to code a few applications from perl builtins, though.