Re^3: how to avoid full scan in file.

Looks like your script creates multiple output records, so if

l100107,bbbbbbb,c_0300,loc,12,6

in FileA matches

l100107,bbbbbbb,c_0300,389

in FileB, the output is 6 lines (the value of $qtd the last column)

l100107,bbbbbbb,loc,12,389
l100107,bbbbbbb,loc,12,389
l100107,bbbbbbb,loc,12,389
l100107,bbbbbbb,loc,12,389
l100107,bbbbbbb,loc,12,389
l100107,bbbbbbb,loc,12,389

Is that what you want ?

Also, can you please explain what this code line does.

last if $count == $max;
[download]

poj

Comment on Re^3: how to avoid full scan in file. Download Code

Replies are listed 'Best First'.
Re^4: how to avoid full scan in file. by EBK (Sexton) on May 25, 2019 at 16:43 UTC
Here the exactly example. I match the file A with the file B through the keys "l100107,bbbbbb,a_0100" so I decrement the $qtd from file A in this example 16 and 24 till 0. Notice that if you sum up this two values they are the $max of file B 40. There is no possibility that my process result different values from both files. I put the $tot in the result file to explain the flow. File A l100107,bbbbbb,a_0100,loc,13,16 l100107,bbbbbb,a_0100,loc,14,24 File B l100107,bbbbbb,a_0100,40 Result File l100107,bbbbbb,loc,13,40,15 l100107,bbbbbb,loc,14,40,23 l100107,bbbbbb,loc,13,40,14 l100107,bbbbbb,loc,14,40,22 l100107,bbbbbb,loc,13,40,13 l100107,bbbbbb,loc,14,40,21 l100107,bbbbbb,loc,13,40,12 l100107,bbbbbb,loc,14,40,20 l100107,bbbbbb,loc,13,40,11 l100107,bbbbbb,loc,14,40,19 l100107,bbbbbb,loc,13,40,10 l100107,bbbbbb,loc,14,40,18 l100107,bbbbbb,loc,13,40,9 l100107,bbbbbb,loc,14,40,17 l100107,bbbbbb,loc,13,40,8 l100107,bbbbbb,loc,14,40,16 l100107,bbbbbb,loc,13,40,7 l100107,bbbbbb,loc,14,40,15 l100107,bbbbbb,loc,13,40,6 l100107,bbbbbb,loc,14,40,14 l100107,bbbbbb,loc,13,40,5 l100107,bbbbbb,loc,14,40,13 l100107,bbbbbb,loc,13,40,4 l100107,bbbbbb,loc,14,40,12 l100107,bbbbbb,loc,13,40,3 l100107,bbbbbb,loc,14,40,11 l100107,bbbbbb,loc,13,40,2 l100107,bbbbbb,loc,14,40,10 l100107,bbbbbb,loc,13,40,1 l100107,bbbbbb,loc,14,40,9 l100107,bbbbbb,loc,13,40,0 l100107,bbbbbb,loc,14,40,8 l100107,bbbbbb,loc,14,40,7 l100107,bbbbbb,loc,14,40,6 l100107,bbbbbb,loc,14,40,5 l100107,bbbbbb,loc,14,40,4 l100107,bbbbbb,loc,14,40,3 l100107,bbbbbb,loc,14,40,2 l100107,bbbbbb,loc,14,40,1 l100107,bbbbbb,loc,14,40,0 [download]	[reply] [d/l]
Re^5: how to avoid full scan in file. by poj (Abbot) on May 25, 2019 at 17:15 UTC
Is it OK if the records are sorted like this ? l100107,bbbbbb,loc,13,40,15 l100107,bbbbbb,loc,13,40,14 .. etc l100107,bbbbbb,loc,13,40,2 l100107,bbbbbb,loc,13,40,1 l100107,bbbbbb,loc,13,40,0 l100107,bbbbbb,loc,14,40,23 l100107,bbbbbb,loc,14,40,22 .. etc l100107,bbbbbb,loc,14,40,2 l100107,bbbbbb,loc,14,40,1 l100107,bbbbbb,loc,14,40,0 poj	[reply]
Re^6.1: how to avoid full scan in file. by EBK (Sexton) on May 25, 2019 at 18:02 UTC
At this point in my process, I can not sort the $ idx column. This distribution I am using is similar to a distribution of playing cards. And I remove 1 item from each loop of each $ idx until it reaches 0.	[reply]
Re: Re^6.1: how to avoid full scan in file. by poj (Abbot) on May 25, 2019 at 18:58 UTC
Re^2: Re^6.1: how to avoid full scan in file. by EBK (Sexton) on May 25, 2019 at 23:38 UTC
Some notes below your chosen depth have not been shown here
Re^6: how to avoid full scan in file. by EBK (Sexton) on May 25, 2019 at 18:00 UTC
At this point in my process, I can not sort the $ idx column. This distribution I am using is similar to a distribution of playing cards. And I remove 1 item from each loop of each $ idx until it reaches 0.	[reply]