This is a non-Perl solution that takes advantage of the (possibly adventitious) structure of the example input data file in which the coordinate field of each record is in numerically ascending order; I assume you want to preserve this order. If, in addition, the distance fields were ordered in the same way, the desired output could be generated by excluding all records that repeat the coordinate field.

The following solution uses the GNU utilities sort and uniq. It may be handier or quicker than a Perl solution, but is also less flexible and extensible. (Note: The following is tested with a GNU-ish port of these utilities to Windoze: best I can do right now.)

>sort -g -k1 -k2 859805.dat | uniq -w12 > 859805.least >cat 859805.least 567 344 5 7 8 1345 567 5 8 123 2346 78 12 1 567 3456 67 10 1 5 4678 45 6 2 0 5349 6 8 2 14 6700 50 13 1 4 8964 560 2 18 8

Also Note: The uniq  -w switch, which seems to be supported by GNU/Linux, may not be supported in other implementations.


In reply to Re: Repeats exclusion by AnomalousMonk
in thread Repeats exclusion by Grig

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.