Then you should not use exec to run the server but rather system. With exec the server will keep the socket to the client open. And probably die with SIGPIPE when the client closes it.
Update: Or you can close the pipe explicitely in the server code.
I believe you should fork the server before using the exec function.