Take a look at Matching data between huge files, it talks about a very similar problem and has many interesting solutions.