I already answered most of your questions in the chatterbox but I'm following up for completeness and the archives. Prior to going farther with this you ought to read both of these links COPY and Populating a database. All it comes down to is COPY is faster than INSERT, indexes slow down copy/insert/update and doing things in batches is better than doing them one at a time. In practical terms that means you're almost right with this approach, it's just your execution that needs help.

First off you need to finish off your COPY command with print WRITEME "\\.\n". You aren't doing such a large load that it probably isn't going to matter if you break this into smaller chunks - 60K records is nothing (my experience anyway). If you were doing an actual large data load then you'd probably break every 10K or so, finish the current COPY, be sure the transaction was complete and start a new transaction/COPY. If you had indexes on the table (which you don't) then it might also be worth it to look at droping them while loading the data and re-instating them afterwards. But then, your instance doesn't merit going to such lengths.

__SIG__
use B;
printf "You are here %08x\n", unpack "L!", unpack "P4", pack
  "L!", B::svref_2object(sub{})->OUTSIDE;

[download]

In reply to Re: Stream data into Postgresql by diotalevi
in thread Stream data into Postgresql by kevsurf

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.