Re: Out of memory and While replacements with excel XLSX application

I have a feeling I am copying the data into memory several times, but I do not know how to avoid this.

Rewrite your program into subroutines, use lots of references, and watch the size of your program at each stage

There is a lot of copy/paste duplication in your program that should be rewritten

There are a lot of short variable names, way too many to keep track of, way too many to help you substantially rewrite what you posted

Also you say The total amount of rows is close to 1 million. and that is close to the MAXIMUM LIMIT for Excel of 1,048,576 rows by 16,384 columns

Comment on Re: Out of memory and While replacements with excel XLSX application

Replies are listed 'Best First'.
Re^2: Out of memory and While replacements with excel XLSX application by Anonymous Monk on Oct 08, 2012 at 09:29 UTC
Here is a start at refactoring Read more... (40 kB) I end up with fudge10 <Reveal this spoiler>	[reply] [d/l] [select]
Re^3: Out of memory and While replacements with excel XLSX application by Anonymous Monk on Oct 08, 2012 at 09:41 UTC
ValueTargetCols should loop over rows first then cols, but it probably makes no difference in the results in this case	[reply]