I didn't know about the Batchmode, and actually, disabling the PasswordAuthentication on the client side worked. I have had problems compiling Net::SSH::Perl (actually some of the dependent modules), so as much as I would like to use it, it have been unable to.