in reply to [OT]:Faster signature algorithm than md5?
In case you haven't seen it, here's a PM Find duplicate files. thread which may assist you.