My suggestion is that once you find out how to weed out the duplicates in perl (I can't help you there) write a quick script to print out all the dupes for your friend. That way he can delete them (if they are incomplete why keep them). You should keep the duplication detection in the main script too but weeding out the dupes every few weeks would be worthwhile -Jonathan Gales