in reply to make a web site searchable

I've never used it myself, but it might have some value here - I don't know what database your using, but MySQL has a Full Text Search capability, and I think Oracle has something similar - not sure about PostgreSQL.

Here's a snippet from a doc I found on www.mysql.com when I did a search(upper right) for 'full text search':

As of Version 3.23.23, MySQL has support for full-text indexing and se +arching. Full-text indexes in MySQL are an index of type FULLTEXT. FU +LLTEXT indexes are used with MyISAM tables only and can be created fr +om CHAR, VARCHAR, or TEXT columns at CREATE TABLE time or added later + with ALTER TABLE or CREATE INDEX. For large datasets, it will be muc +h faster to load your data into a table that has no FULLTEXT index, t +hen create the index with ALTER TABLE (or CREATE INDEX). Loading data + into a table that already has a FULLTEXT index will be slower. Full-text searching is performed with the MATCH() function. mysql> CREATE TABLE articles ( -> id INT UNSIGNED AUTO_INCREMENT NOT NULL PRIMARY KEY, -> title VARCHAR(200), -> body TEXT, -> FULLTEXT (title,body) -> ); Query OK, 0 rows affected (0.00 sec) mysql> INSERT INTO articles VALUES -> (NULL,'MySQL Tutorial', 'DBMS stands for DataBase ...'), -> (NULL,'How To Use MySQL Efficiently', 'After you went through a + ...'), -> (NULL,'Optimising MySQL','In this tutorial we will show ...'), -> (NULL,'1001 MySQL Tricks','1. Never run mysqld as root. 2. ...' +), -> (NULL,'MySQL vs. YourSQL', 'In the following database compariso +n ...'), -> (NULL,'MySQL Security', 'When configured properly, MySQL ...'); Query OK, 6 rows affected (0.00 sec) Records: 6 Duplicates: 0 Warnings: 0 mysql> SELECT * FROM articles -> WHERE MATCH (title,body) AGAINST ('database'); +----+-------------------+------------------------------------------+ | id | title | body | +----+-------------------+------------------------------------------+ | 5 | MySQL vs. YourSQL | In the following database comparison ... | | 1 | MySQL Tutorial | DBMS stands for DataBase ... | +----+-------------------+------------------------------------------+ 2 rows in set (0.00 sec)
and it continues on...

Here's the link to this page:

http://www.mysql.com/doc/en/Fulltext_Search.html

HTH.