in reply to RSS Feed Aggregation

The ping feeds are _not_ meant for people looking to be notified of updates to only a small subset. Your best bet is to use Bloglines' (WebService-Bloglines) or NewsGator's apis to pull updates to your subscriptions. RSS aggregation sucks a lot of bandwidth, so if you're not careful, you might find your IP blocked. Definitely try to use an existing aggregator (Plagger looks interesting). Pulling feeds efficiently, and respectfully, is more involved than simple HTTP fetching.

As for full content, look to see if a third party is already doing that for your feed. For instance, I subscriber to alterslash, instead of slashdot.

Replies are listed 'Best First'.
Re^2: RSS Feed Aggregation
by Aristotle (Chancellor) on Mar 03, 2006 at 19:03 UTC

    Writing your own is not that hard through. A 5-minute-tutorial is available in HTTP Conditional Get for RSS Hackers, which is an absolute must-read for anyone writing feed aggregation code.

    Makeshifts last the longest.

[reply]
      Thanks, I think I will give that a try, and will also look into Plagger. Although, if Plagger does the same thing as conditional gets, I don't see why I can't just hack it up in 5 minutes using conditional gets in my existing code.
[reply]

        Thanks for your interest on Plagger. Plagger is a pluggable aggregation platform where you can plug components just like LEGO to build your own aggregator.

        As for smart GET (conditinal GET), the latest version in our svn repository supports it by using the default aggregator component (Aggregator::Simple). I'm planning to release the CPAN version in this weekend.

        --
Tatsuhiko Miyagawa
miyagawa@cpan.org
[reply]

In Section Seekers of Perl Wisdom