in reply to eliminating duplicates with filters

have spent so much time for this pgm with unfruitful results please help me with it
It would be best to post what you have tried so far. Post your code and input data inside "code" tags to make your post more readable (Writeup Formatting Tips).

Perl has great documentation available on your command line:

perldoc -q duplicate

You should try to use a hash. See also perldsc.