Any insight in how to tackle this would be appreciated.

I recommend using Text::CSV_XS to parse the input file. If duplicates are always on consecutive lines, then you can just remember the previous line, then combine the lines once they are parsed.

If you are having trouble with any specific portion of your code, post it here.