I've recently looked at DamageControl (URL in original post is outdated) for a Ruby project. Sadly, it's pretty unusable in my experience. There's a bug that prevents it from even running on linux at the moment.

Maybe I just got unlucky..

Incidentally there's another continuous integration tool for Ruby on Rails/Rake without many bells and whistles that worked for me: CIA

florg