in reply to Search Engine Theory
The Secret is actually to use a fast DB. Like MySQL. You have to build an index of the words in one table and relate the documents to the keywords. It is just do a "dynamic" SQL select. Much faster than a grep cycle. Due to the index of the index! The grep thing goes through the whole index!