in reply to Finding duplicated items in table.
See perlfaq4 about "duplicate". Just parse your table into the appropriate fragments, then remove the duplicate fragments, then output the rest.