A side note - Send-Q refers to amount of data queued (bytes), not number of packets.

Regarding your problem. Perhaps you could enable SO_KEEPALIVE on the socket, possibly with tweaked TCP_KEEP* values, so that recovery can happen in a timely manner? See Socket, socket(7), and tcp(7).