Use Net::SFTP::Foreign instead. It uses the binary ssh client under the hood, so if that is well configured it would work!