Re^2: Download only part of a file from the web

Any update? Or does anyone know of any tool that allows restricting the download size?

I am also trying to write a tool to automate analysis of flv files on the web. The clip analysis can be done with a header preview, so I want similar functionality to avoid full download.

Best regards,
-Avid (seeker of perl wisdom)

Comment on Re^2: Download only part of a file from the web

Replies are listed 'Best First'.
Re^3: Download only part of a file from the web by tilly (Archbishop) on Dec 30, 2008 at 21:31 UTC
LWP::UserAgent has a max_size method that can limit the size that will be retrieved to a fixed number of bytes. Or you can be more ambitious and pass a :content_cb callback to the get method. This will give you the response in chunks and you can then accumulate them in a variable. When your analysis says that you have enough you can die to end the request, and catch that at a higher level with an eval. This will be a lot more complex, but avoids having to guess how much of the file to download.	[reply]

Replies are listed 'Best First'.

Re^3: Download only part of a file from the web
by tilly (Archbishop) on Dec 30, 2008 at 21:31 UTC

LWP::UserAgent

Or you can be more ambitious and pass a :content_cb callback to the get method. This will give you the response in chunks and you can then accumulate them in a variable. When your analysis says that you have enough you can die to end the request, and catch that at a higher level with an eval. This will be a lot more complex, but avoids having to guess how much of the file to download.

[reply]