Thanks guys, I finally figured it out. I had to put
$client_socket->shutdown(0); #at the server end.
and $socket->shutdown(1); #at the client end.