in reply to Re^3: Huge data file and looping best practices
in thread Huge data file and looping best practices
I'm not really sure about your approach. I'd really prefer to limit the data being processed as soon as possible, to save extra time later.
From what OP writes it looks like his working model on this problem is rather an experimental one and it is not known how many iterations of parsing the same data will be needed, just to discover some patterns and regularities. In such case I would go with limiting the input as much as possible.
|
---|