I'd be very suprised if the delay in sysread() was caused by anything other than a corresponding delay in the underlying network traffic. Note that transmitting 600 bytes on a 100 Mbit/s network takes 0.04ms.
I'd suggest running a packet sniffer to see what's happening.