Re^2: Best way to look-up a string amongst 100 million of its peers

Thanks for all the advice.

I had originally tried MySQL and loading the list was fast enough (load data infile...) but I gave up on the indexing process after 24 hours.

On your recommendation I have managed to get the list into CDB and the performance of that seems pretty decent! I also love that I don't need to be running a database for such a simple look-up.

To answer all your questions about the nature of the data... just go to the URL where I just now got this up and running ;)

https://domize.com

Comment on Re^2: Best way to look-up a string amongst 100 million of its peers

Replies are listed 'Best First'.
Re^3: Best way to look-up a string amongst 100 million of its peers by assemble (Friar) on Mar 26, 2008 at 17:40 UTC
I've got to say, that's a pretty nifty little tool :) One suggestion is to make it only lookup after a change if the field hasn't changed again in the last half second or so. I tried a few domains. Some results weren't exactly right, but it's a cool little script nonetheless.	[reply]