in reply to Re: Remote database and process
in thread Remote database and process

Hi, Am planning to localfile for further processing.

Replies are listed 'Best First'.
Re^3: Remote database and process
by BrowserUk (Patriarch) on Jun 07, 2010 at 07:48 UTC

    Then I would suggest you look at the mysql --quick command & option.

    If you combine that with the mysql < script.sql > results., the memory usage by the local process will be minimal and the results will be retrieved and filed far more quickly than you will ever achieve with Perl & DBI. (Sorry if that offends anyone, but it is true!)


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
      (Sorry if that offends anyone, but it is true!)

      Disclaimers are so offensive

      :p

        I've never laimed any discs!

        Well. There was that one I used as a coaster but ...

      Hi, I wonder if POE::Component::DBIAgent - POE Component for running asynchronous DBI calls is efficient to do? Please sugguest.

        If a single DBI query returns (and caches) sufficient data to cause you to have memory problems in a stand-alone process; running multiple concurrent queries via POE (or anything else isn't going to prevent that problem from occuring.

        The --quick option of the mysql command is specifically designed to return query results row by row rather than accumulating them all in memory and returning them en-masse. Hence my suggestion to use that.


        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.