When you really want to slurp terabytes, you may look at XML-fame Tim Bray's Widefinder contest. The winning entry was Sean O'Rourke's clever perl script which puts your multi-core CPU to proper use.