In general: 

c:\@Work\Perl\monks>perl -wMstrict -le
"use List::MoreUtils qw(uniq);
 ;;
 my @data = qw(
   NC_009565:0  NC_017524:0  NC_017522:0  NC_018143:0
   NC_017026:0  NC_017523:0  NC_016934:1  NC_018078:0
   NC_017026:0  NC_017523:0  NC_016934:1  NC_018078:0
   NC_999999:0  NC_999999:1
   NC_021193:0  NC_016768:0  NC_021251:0  NC_021192:0
   NC_012943:0  NC_002755:0  NC_020559:0  NC_020089:0
   NC_999999:1  NC_999999:0
   );
 ;;
 my @uniq = uniq @data;
 ;;
 printf qq{%d in \@data \n}, scalar @data;
 printf qq{%d in \@uniq \n}, scalar @uniq;
 print qq{'$_'} for @uniq;
"
24 in @data
18 in @uniq
'NC_009565:0'
'NC_017524:0'
'NC_017522:0'
'NC_018143:0'
'NC_017026:0'
'NC_017523:0'
'NC_016934:1'
'NC_018078:0'
'NC_999999:0'
'NC_999999:1'
'NC_021193:0'
'NC_016768:0'
'NC_021251:0'
'NC_021192:0'
'NC_012943:0'
'NC_002755:0'
'NC_020559:0'
'NC_020089:0'

[download]
I leave to you the task of extracting the protein (?) and NC_ info from all records and associating the latter (after uniq-ification) with the former. See List::MoreUtils::uniq().

Give a man a fish:  <%-{-{-{-<

In reply to Re: merge lines removing duplicates in a file by AnomalousMonk
in thread merge lines removing duplicates in a file by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.