Why not just use the "callback" parameter of request or simple_request, and grab the data as it comes back?

Seems like you've reinvented a pretty big wheel. {grin}

From perldoc LWP::UserAgent... 

       The subroutine variant requires a reference to callback
       routine as the second argument to request() and it can
       also take an optional chuck size as the third argument.
       This variant can be used to construct "pipe-lined" pro-
       cessing, where processing of received chuncks can begin
       before the complete data has arrived.  The callback func-
       tion is called with 3 arguments: the data received this
       time, a reference to the response object and a reference
       to the protocol object.  The response object returned from
       request() will have empty content.  If the request fails,
       then the the callback routine is called, and the
       response->content might not be empty.

       The request can be aborted by calling die() in the call-
       back routine.  The die message will be available as the
       "X-Died" special response header field.

       The library also allows you to use a subroutine reference
       as content in the request object.  This subroutine should
       return the content (possibly in pieces) when called.  It
       should return an empty string when there is no more con-
       tent.

[download]

-- Randal L. Schwartz, Perl hacker

In reply to RE: to post, or not to post... by merlyn
in thread to post, or not to post... by japhy

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.