That's exactly why I asked several time for a detailed explanation of what you need. From your last message describing your requirement,your files you were just looking for records common to all files in our collection. Now your need is different.
The method I suggested is still possible, but with a slight modification. When you compare all your files with the first one, write to disk the records that were not found in the hash. You'll end up with versions of all the other files with records from.the first file filtered out. At this point, the original %seen hash is no longer needed. Your can now compare the filtered file2 (presumably significantly smaller than the original one) with file3, file4, etc (also filtered and smaller), and so one. And you end up with a situation where your input file get smaller and smaller and, at any given point in the process, you only have one file in memory.
You write stuff to disk, but the amount of data you need to handle is shrinking at each step in the process.
| [reply] |
I am very sorry but still not getting your point. | [reply] |
I want to compare all files with each other and not first file with all other. Hope I am clear. may be the records are present in second and third file but not in first. I need them also. | [reply] |
I tried with your solution but getting errors with script. I cannot solve the problem. please please help me with a short example. I have to get through this issue for further processing. Please help me and sorry for the inconvenience caused to you because of the unclear details earlier. | [reply] |
Please help us help you better by showing us the code you have and the exact error messages you get. This enables us to much better pinpoint where you are having problems.
Please note that this is not a code writing service. While we will try to help you understand what happens and try to teach you approaches to a solution, we expect you to program the solution yourself. Asking for "short examples" makes me feel like you expect us to do your paid work for free. This is not how this site works.
| [reply] |
| [reply] |
Please show the script that you tried and show the exact error message you're getting. I am afraid we can't help you further if you don't help us helping you.
| [reply] |