in reply to Re^2: Out of Memory Error : V-Lookup on Large Sized TEXT File
in thread Out of Memory Error : V-Lookup on Large Sized TEXT File

I think that I posted a relevant reply.

In general you want to read the input file(s) once. That is because this is an "expensive" operation in terms of I/O performance.

If you wind up with a scenario where for each line of an input file B, you have to re-read each line of input file A, that is very inefficient. And it will take a lot of MIPs (N*N).

  • Comment on Re^3: Out of Memory Error : V-Lookup on Large Sized TEXT File