I don't have any ideas about how to reduce your buffering problems with LWP.

I'm curious about why you didn't/can't use Net::FTP, which is all about file-slinging, as opposed to LWP, which is mostly about content.