You may wish to look at open utility cURL. The website http://curl.haxx.se/ has sample perl programs such as curlmirror.pl to mirror many files. I have not used cURL but it looks like an interesting utility. Hope this helps.