Monks ~
I've hit on one of those wonderful issues that you can only learn when it's too late -- when using LWP::UserAgent to validate the existance of a file before creating a link to it, it will read the entire file into memory. When the files are huge, they are running me out of system memory.
I've attempted to set the following:
my $ua = LWP::UserAgent->new(env_proxy =>1,
max_size => 100,
);