in reply to Is there a better way to do this? I need to keep track of results...
Why not store the url as identifier. http://washingtondc.craigslist.org/mld/sks/1040593349.html
Or.. you can wget the message and md5sum the content. That way you save md5sum, url, and timestamp of when you got it. The rest is trash.
You could do this with a simple hash. Store it with YAML.. or even better: File::Cache !
my %hits = {
$md5sum => { url => $url, time => time() },
};
|
|---|