Maybe not. It depends on whether the duplicates are significant or not. That wasn't specified in the question.

-pete
"Worry is like a rocking chair. It gives you something to do, but it doesn't get you anywhere."