in reply to Re: Using text files to remove duplicates in a web crawler
in thread Using text files to remove duplicates in a web crawler

I whole heartedly agree with the above, and once in a database the infomation can be accessed by lots of other applications as well. Surely a massive advantage.
  • Comment on Re^2: Using text files to remove duplicates in a web crawler

In Section Seekers of Perl Wisdom