Check out this excerpt from O'Reilly's Spidering Hacks.

HTH,

Vautrin,

---

Want to support the EFF and FSF by buying cool t-shirts? Click here