My first thought would be to check out the news related modules on the CPAN. Additionally, check out the RSS modules. RSS (RDF Site Summary) is a great tool and should help out. However, that requires that the sites you wish to crawl have RSS feeds.

There are also the google-related modules. I'm particularly curious about the DBD::Google module. It might be perfect, but it looks new.

Cheers,
Ovid

New address of my CGI Course.
Silence is Evil (feel free to copy and distribute widely - note copyright text)