However, would this mean that every client would have to send something to the server every time they want to receive something?

No, just once. Well, maybe once in a while. The server should forget connects that it has received a long time ago to avoid sending to a machine that didn't properly disconnect, but that's no longer interested.