I recently did a poor man's benchmark just for kicks. The results might at least be interesting to you.

I wrote this little script to populate a db with 50,000 rows into a db table of three columns (one just an autoinc id). 

#!/usr/bin/perl

use strict;
use warnings;

use Data::Dumper; $Data::Dumper::Indent = 3;
use Digest::MD5 qw/md5_base64/;

use base qw/DBIx::Class::Schema::Loader/;
DBIx::Class::Schema::Loader->loader_options( relationships => 1 );

my $schema = DBIx::Class::Schema::Loader->connect('dbi:SQLite:/tmp/tes
+t');
#my $schema = DBIx::Class::Schema::Loader->connect('dbi:Pg:dbname=test
+', 'postgres', '' );
#my $schema = DBIx::Class::Schema::Loader->connect('dbi:mysql:dbname=t
+est', 'mysql', '' );


my @inserts;

for ( 1 .. 50000 ) {

    push @inserts,
        {
          foo => md5_base64( $_ . 'foo' ),
          bar => md5_base64( $_ . 'bar' )
        };

}

my $new_row = $schema->resultset('TestTable');

$new_row->populate( \@inserts );

[download]

Loading to postgresql-server-8.1.9-2.1 took just under 8 minutes, mysql-5.0.26-12 about 35 seconds, sqlite-3.3.8-14 even with synchronous mode turned off couldn't even seem to handle 1000 rows a minute (I didn't wait for it to finish all 50,000 rows). I reused this script just now for writing 50,000 lines to a flat text file and it was done almost before I pressed enter.

Obviously YMMV. My workstation is a sun ultra 40 dual opteron with a pair of sata drives that I striped into a raid 0 and I'm running opensuse 10.2.

--
naChoZ

Therapy is expensive. Popping bubble wrap is cheap. You choose.

In reply to Re: Which is quicker - writing to a file or inserting into a db? by naChoZ
in thread Which is quicker - writing to a file or inserting into a db? by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.