in reply to Merging/Joining Multiple Large Files

bernanke01:

If I understand your question correctly, then if you're on unix, or cygwin under windows, you could just:

sort -u file1 file2 file3 | awk 'NF==10 {print}'
The sort -u just concatenates all the files sorts the result and emits only the unique lines. The awk filter then selects only the lines with 10 fields (to eliminate rows with missing fields). Salt to taste...

...roboticus