in reply to fast simple DB (sqlite?) skeleton?

I have tried a version with DBI and SQLite, but insertion was very, very slow.

Perhaps you're commiting for every insert, perhaps through autocommit? If so, turn autocommit off, keep a bit of bookkeeping and commit only every N inserts.

Replies are listed 'Best First'.
Re^2: fast simple DB (sqlite?) skeleton?
by Anonymous Monk on Jan 26, 2010 at 12:21 UTC
    I had to deal with the same problem a few years ago using Sqlite. It's a lot faster if you insert the whole data as a transaction. Use: 
    BEGIN TRANSACTION;
INSERT .....
COMMIT;

    [download]
    This should speed up the process. Good luck.
[reply]
[d/l]

In Section Seekers of Perl Wisdom