Net::SFTP::Foreign is slow

ssubrat77 has asked for the wisdom of the Perl Monks concerning the following question:

Replies are listed 'Best First'.
Re: Net::SFTP::Foreign is slow by syphilis (Archbishop) on Jul 11, 2011 at 23:28 UTC
Please advise how to improve the performance or any other solution for SFTP On windows ? If so see http://www.perlmonks.org/index.pl?node_id=912896. (The solution outlined there works for all versions of perl later than 5.5.) Cheers, Rob	[reply]
Re^2: Net::SFTP::Foreign is slow by ssubrat77 (Novice) on Jul 12, 2011 at 01:29 UTC
Thanks Rob for your help. I have installed "Net-SFTP-Foreign-Backend-Net_SSH2" and modified the code as below, but getting this error, please guide if I have done something wrong. `use Net::SFTP::Foreign; my $sftp = Net::SFTP::Foreign->new( host => 'delivery.myserver.com', port => '22', backend => 'Net_SSH2', user => 'ftp_user', more => [qw(-i mytransaction.private.key.ppk)], ssh_cmd => 'plink'); $sftp->die_on_error("Unable to establish SFTP connection");` [download] error is "Invalid options 'ssh_cmd', 'more' or bad combination of options at sftp.pl line 2"	[reply] [d/l]
Re^3: Net::SFTP::Foreign is slow by salva (Canon) on Jul 12, 2011 at 08:58 UTC
syphilis is right, you can't use `more` or `ssh_cmd` with the `Net_SSH2` backend. Do as follows: `use Net::SFTP::Foreign 1.67; use Net::SFTP::Foreign::Backend::Net_SSH2 0.04; my $sftp = Net::SFTP::Foreign->new( host => 'delivery.myserver.com', port => '22', backend => 'Net_SSH2', user => 'ftp_user', key_path => "mytransaction.private +.key"); $sftp->die_on_error("Unable to establish SFTP connection");` [download] You will probably have to convert the private key from PuTTY to OpenSSH format and place the public key in the same directory with the `.pub` suffix.	[reply] [d/l] [select]
Re^4: Net::SFTP::Foreign is slow by ssubrat77 (Novice) on Jul 13, 2011 at 05:01 UTC
Re^5: Net::SFTP::Foreign is slow by salva (Canon) on Jul 13, 2011 at 09:36 UTC
Some notes below your chosen depth have not been shown here
Re^4: Net::SFTP::Foreign is slow by ssubrat77 (Novice) on Jul 12, 2011 at 18:17 UTC
Re^5: Net::SFTP::Foreign is slow by syphilis (Archbishop) on Jul 12, 2011 at 23:26 UTC
Re^3: Net::SFTP::Foreign is slow by syphilis (Archbishop) on Jul 12, 2011 at 04:22 UTC
Invalid options 'ssh_cmd', 'more' or bad combination of options at sftp.pl line 2 It may be that the 'more' and 'ssh_cmd' options don't work on Windows - I'm almost certain 'more' doesn't work. If salva drops by (as he usually does) he would be able to give you more definitive advice. I've only ever used this module for 'get', 'put', 'del', 'ls' and maybe a couple of other commands that I can't recall at the moment. For those purposes I've found it to be excellent. Cheers, Rob	[reply]
Re: Net::SFTP::Foreign is slow by runrig (Abbot) on Jul 11, 2011 at 22:56 UTC
Net::SFTP::Foreign is a wrapper for doing sftp over command line ssh. Math-BigInt would not help there. You can also try Net-SSH2.	[reply]
Re: Net::SFTP::Foreign is slow by salva (Canon) on Jul 12, 2011 at 09:10 UTC
Net::SFTP::Foreign on Windows uses a small pipeline (due to the lack of a proper `select` able to work in pipes), so, if your network has a relative high latency, it would perform poorly. Try incrementing the pipeline size as follows: `$sftp = Net::SFTP::Foreign->new(..., queue_size => 32);` [download] If that doesn't improve the transfer speed, add... `$Net::SFTP::Foreign::debug = 1\|32\|256;` [download] at the beginning of your script and post here the output or send it to me by email (I am the module author btw).	[reply] [d/l] [select]
Re^2: Net::SFTP::Foreign is slow by ssubrat77 (Novice) on Jul 12, 2011 at 19:24 UTC
Hi Salva, There is no improvement of adding the queue_size. I trust there is no issue with network as am able to download same file by WinSCP and performance is far better. I don't have your mail id so attaching some part of the debug message here #8788 1310498030.00000 got it!, len:32777, code:103, id:109, status: - #8788 1310498030.00000 queueing msg len: 25, code:5, id:141 ... [32] #8788 1310498030.00000 waiting for message... [32] #8788 1310498031.00000 got it!, len:32777, code:103, id:110, status: - #8788 1310498031.00000 queueing msg len: 25, code:5, id:142 ... [32] #8788 1310498031.00000 waiting for message... [32] #8788 1310498032.00000 got it!, len:32777, code:103, id:111, status: - #8788 1310498032.00000 queueing msg len: 25, code:5, id:143 ... [32] #8788 1310498032.00000 waiting for message... [32] #8788 1310498033.00000 got it!, len:32777, code:103, id:112, status: - #8788 1310498033.00000 queueing msg len: 25, code:5, id:144 ... [32] #8788 1310498033.00000 waiting for message... [32] #8788 1310498034.00000 got it!, len:32777, code:103, id:113, status: - #8788 1310498034.00000 queueing msg len: 25, code:5, id:145 ... [32] #8788 1310498034.00000 waiting for message... [32] #8788 1310498035.00000 got it!, len:32777, code:103, id:114, status: - #8788 1310498035.00000 queueing msg len: 25, code:5, id:146 ... [32] #8788 1310498035.00000 waiting for message... [32] #8788 1310498037.00000 got it!, len:32777, code:103, id:115, status: - #8788 1310498037.00000 queueing msg len: 25, code:5, id:147 ... [32] #8788 1310498037.00000 waiting for message... [32] #8788 1310498038.00000 got it!, len:32777, code:103, id:116, status: - #8788 1310498038.00000 queueing msg len: 25, code:5, id:148 ... [32] [download]	[reply] [d/l]
Re^3: Net::SFTP::Foreign is slow by salva (Canon) on Jul 12, 2011 at 21:07 UTC
What version of the module were you using when you got this output?	[reply]
Re^4: Net::SFTP::Foreign is slow by ssubrat77 (Novice) on Jul 12, 2011 at 21:35 UTC
Re^5: Net::SFTP::Foreign is slow by salva (Canon) on Jul 12, 2011 at 21:45 UTC
Some notes below your chosen depth have not been shown here