in reply to Re^2: How to remove duplicates from a large set of keys
in thread How to remove duplicates from a large set of keys
Lookup in a hash of 1 million keys is rougly the same as lookup in a hash of 10 keys. :-) (Assuming you are still inside of physical memory.)
Its creating the hash thats the problem. It takes a long time, especially if you dont know how many records you are storing up front.
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^4: How to remove duplicates from a large set of keys
by nite_man (Deacon) on Feb 10, 2005 at 09:04 UTC | |
by demerphq (Chancellor) on Feb 10, 2005 at 09:20 UTC |