in reply to processing slows way down

When doing large inserts on a database, sometimes you better delete the indexes on the tables you insert into and rebuild the indexes once all the inserts have been processed. The idea is that it is much more efficient to do all the indexing at once rather than in little steps.

CountZero

"If you have four groups working on a compiler, you'll get a 4-pass compiler." - Conway's Law

Replies are listed 'Best First'.
Re^2: processing slows way down
by Anonymous Monk on Jul 10, 2004 at 14:53 UTC
    Thank you for responding.

    I ran one 32,000 line input file in about an hour. I ran another 32,000 line input file right after also in about an hour, without rebuilding indexes.

    If what you suggest were true wouldn't each time an input file was loaded, without rebuilding the indexes it should get progressively slower?
      Not necessarily in such a way that one would see it easily. If you have a database with a million records and you first add 32,000 records and then again 32,000 records, the time-difference between the two runs is probably too small to notice.

      CountZero

      "If you have four groups working on a compiler, you'll get a 4-pass compiler." - Conway's Law