Use a hash. If the link already exists in the hash, you can skip it. Otherwise process the link and add it to the hash.

---

Dr. Michael K. Neylon - mneylon-pm@masemware.com || "You've left the lens cap of your mind on again, Pinky" - The Brain