Re^2: Using Net::FTP::Throttle

Thanks BrowserUK!

With the max-burst doubled, I was seeing better throughput. So I doubled it again and it looks like now I'm seeing around 50mbps

Regarding the block size, I thought the same, however it seemed that anything over 4K was not helping, and I only got better throughput by decreasing it to 1024 and finally 512. Perhaps now that I've increased max-burst, a larger block size wouldn't hurt?

at least this is working now; I wonder if Net::FTP::Throttle should be updated to increase that max-burst? How does stuff like that get done, should I be prompting someone or going at it myself?

kind regards, Joe

Comment on Re^2: Using Net::FTP::Throttle

Replies are listed 'Best First'.
Re^3: Using Net::FTP::Throttle by BrowserUk (Patriarch) on Aug 02, 2012 at 23:06 UTC
How does stuff like that get done, should I be prompting someone or going at it myself? I'd start by sending the author an email pointing to this thread at perlmonks and go from there. With regard to blocksize. I just did some not-very-representative testing using the loopback address on my machine and with 4k blocks the maximum throughput I can get is 140MB/s: `C:\test>sock-rated.pl -O=4 -I=4 1000 svr: request for 1048576000 1048576000 took 6.999 seconds. [142.89 MB/s]` [download] By using 100k blocks, I can get that up to over 300MB/s: `C:\test>sock-rated.pl -O=100 -I=100 10000 svr: request for 10485760000 10485760000 took 33.032 seconds. [302.74 MB/s]` [download] Not a real-world test, but still 4k seems like a pifflingly small amount. With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday' Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error. "Science is about questioning the status quo. Questioning authority". In the absence of evidence, opinion is indistinguishable from prejudice. The start of some sanity?	[reply] [d/l] [select]

Replies are listed 'Best First'.

Re^3: Using Net::FTP::Throttle
by BrowserUk (Patriarch) on Aug 02, 2012 at 23:06 UTC

How does stuff like that get done, should I be prompting someone or going at it myself?

I'd start by sending the author an email pointing to this thread at perlmonks and go from there.

With regard to blocksize. I just did some not-very-representative testing using the loopback address on my machine and with 4k blocks the maximum throughput I can get is 140MB/s:

C:\test>sock-rated.pl -O=4 -I=4 1000
svr: request for 1048576000 
1048576000 took 6.999 seconds. [142.89 MB/s]
[download]

By using 100k blocks, I can get that up to over 300MB/s:

C:\test>sock-rated.pl -O=100 -I=100 10000
svr: request for 10485760000 
10485760000 took 33.032 seconds. [302.74 MB/s]
[download]

Not a real-world test, but still 4k seems like a pifflingly small amount.

With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'

Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.

"Science is about questioning the status quo. Questioning authority".

In the absence of evidence, opinion is indistinguishable from prejudice.

The start of some sanity?

[reply]
[d/l]
[select]