Re^4: How can I improve the sql statements applying efficiency

Marshall

In fact each of my file is a whole transaction since there is BEGIN TRAN at the beginning of the file and COMMIT TRAN at the end of the file. And I have tried to treat each statement as a transaction, but the efficiency seems almost the same.

I don't get into this kind situation a lot, in daily work the script only process say 2k records, but this time I want to process all the records accumulated during the past 2 or 3 years. 4 to 5 hours should be good, but more than 20 hours is a little out of control.

Comment on Re^4: How can I improve the sql statements applying efficiency

Replies are listed 'Best First'.
Re^5: How can I improve the sql statements applying efficiency by Marshall (Canon) on Jul 25, 2010 at 09:39 UTC
Try: improve SQL statement efficiency. I am confident that you will get a 4x-5x performance increase. That's what you need to go from 20 hours->5 hours or less. This won't achieve 15-20 minutes, but that's not what is needed. The idea as I understand it is to make a dramatic improvement in performance with the understanding that the performance won't be optimal. If you can "make it work" for this abnormal 2-3 year combined update, I would do so. Pursue other performance enhancements if need be (or not).	[reply]

Replies are listed 'Best First'.

Re^5: How can I improve the sql statements applying efficiency
by Marshall (Canon) on Jul 25, 2010 at 09:39 UTC

improve SQL statement efficiency

If you can "make it work" for this abnormal 2-3 year combined update, I would do so. Pursue other performance enhancements if need be (or not).

[reply]