Looks like similar discussions can be found under:
Search Engine Theory
Search engine
Can dynamic sites be parsed by search engine robots?
Miniature search engine
You'll find talk on various aspects of what you're trying to do and more pointers to reference material. Some of which eduardo has already pointed out. Some is barely related, but it's not bad.