There is also a select call in the client loop that can be another cause delay. Select has the option of providing a timeout value, but the SSH2.pm code doesn't utilize it. The solution is discussed here:

Re^4: Net::SSH::Perl hangs(during cmd), but only in Mason environment