in reply to Fastest way to merge (and de-dup) two large arrays?
If you have a choice on how to keep your data, then the smart way is to keep it sorted. Merging the two collections is then a simple matter of streaming merge. Typically, this can be done as fast as you can do the i/o.
|
|---|