Did you mean something like this?

Data like 1nickt but with dups.

fred,barney,wilma,betty
foo,bar,baz,qux
foo,bar,baz,qux
fred,barney,wilma,betty
fred,barney,wilma,betty
apple,orange,banana,pear
apple,orange,banana,pear
foo,bar,baz,qux
fred,barney,wilma,betty
apple,orange,banana,pear

[download]
#!/usr/bin/env perl

use strict;
use warnings;
use feature qw (say);
use Data::Dump;
use Iterator::Simple qw(iter);

my $file = q(1204245.csv);

my %column;

open my $fh, q(<), $file or die $!;

while (<$fh>) {
    chomp;
    $column{ ( split /,/ )[2] } = undef;
}

close $fh;

dd \%column;

# what ever..
say for sort { $b cmp $a } keys %column;

say q(--);

# or
my $iterator = iter( IO::File->new($file) );

while (<$iterator>) {
    chomp;
    $column{ ( split /,/ )[2] } = undef;
}

dd \%column;

say for sort { $a cmp $b } keys %column;

__END__

karls-mac-mini:monks karl$ ./1204245.pl
{ banana => undef, baz => undef, wilma => undef }
wilma
baz
banana
--
{ banana => undef, baz => undef, wilma => undef }
banana
baz
wilma

[download]
"...dataset get significantly larger..."

Perhaps the solution with Iterator::Simple performs better. But I guess - and your mileage may vary. See also Benchmark.

Best regards, Karl

«The Crux of the Biscuit is the Apostrophe»

perl -MCrypt::CBC -E 'say Crypt::CBC->new(-key=>'kgb',-cipher=>"Blowfish")->decrypt_hex($ENV{KARL});'Help

In reply to Re: search/grep perl/*nix by karlgoethebier
in thread search/grep perl/*nix by Gtforce

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.