in reply to Pushing unique items onto an array

Use a hash instead of an array to store your links. E.g.
$links{'http://www.slashdot.org'} = 1;
Then just use keys %links to get the list back.

-Matt