Thanks to everyone for responding and for the helpful suggestions to improve my code. I didn't find any duplicate lines in the infile so I am examining the rest of the script to see where the error might lie.
Best- BD