You could try forking a few processes and divide the work up between child processes - having each child read recursively down a separate directory will speed things up. You could feed it a list of directories to open - or even have your application find directories - and fork off processes based on the number of directories.