Duplicated data in array.

Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

Hi Monks!

I need to get rid of the duplicates coming from an array, as a sample here is some data:


 $VAR1 = {
           'ID' => '11',
           'Name' => 'Mary',
           'CC' => 'X5667'
         };
 $VAR2 = {
           'ID' => '10',
           'Name' => 'Joe',
           'CC' => 'X456'
         };
 $VAR3 = {
           'ID' => 'X2',
           'Name' => 'Carl',
           'CC' => 'P45'

         };
 $VAR4 = {
           'ID' => '12',
           'Name' => 'Jim',
           'CC' => 'PK1'
          ;
 $VAR5 = {
           'ID' => '11',
           'Name' => 'Mary',
           'CC' => 'X5667'
         };
[download]

Is there a better or correct way of doing this?

#!/usr/bin/perl


use strict;
use warnings;

use Data::Dumper;


 foreach my $st ( @{ $stuff } ) {


   next if $st->{ID};
   next if $st->{Name};
   next if $st->{CC};

   print $st->{ID} - $st->{Name} - $st->{CC};
   
 }
[download]

Thanks for looking!

Comment on Duplicated data in array. Select or Download Code

Replies are listed 'Best First'.
Re: Duplicated data in array. by LanX (Saint) on Nov 02, 2021 at 19:31 UTC
Your data is missing a curly again. anyway, others may profit from this use strict; use warnings; use Data::Dump qw/pp dd/; my @in = ( { CC => "X5667", ID => 11, Name => "Mary" }, { CC => "X456", ID => 10, Name => "Joe" }, { CC => "P45", ID => "X2", Name => "Carl" }, { CC => "PK1", ID => 12, Name => "Jim" }, { CC => "X5667", ID => 11, Name => "Mary" }, ); # --- Version1 ID deserves its name my %seen1; my @out1 = grep { ! $seen1{ $_->{ID} }++ } @in; pp \@out1; # --- Version2 combine values to one multi-dim key my %seen2; my @out2 = grep { ! $seen2{ $_->{ID}, $_->{Name}, $_->{CC} }++ } @in; pp \@out2; [download] Cheers Rolf _{(addicted to the Perl Programming Language :) Wikisyntax for the Monastery}	[reply] [d/l]
Re^2: Duplicated data in array. by Bod (Parson) on Nov 03, 2021 at 00:21 UTC
Your data is missing a curly again Some would say consistency is a good thing...	[reply]
Re^3: Duplicated data in array. by Fletch (Bishop) on Nov 03, 2021 at 14:50 UTC
“A foolish consistency is the hobgoblin of little minds, adored by little statesmen and philosophers and divines." – Ralph Waldo Emerson The cake is a lie. The cake is a lie. The cake is a lie.	[reply]
OT - foolish consistency, was Re^4: Duplicated data in array. by soonix (Canon) on Nov 04, 2021 at 08:38 UTC
Re: OT - foolish consistency, was Re^4: Duplicated data in array. by Fletch (Bishop) on Nov 04, 2021 at 14:09 UTC
Some notes below your chosen depth have not been shown here
Re^2: Duplicated data in array. by Anonymous Monk on Nov 02, 2021 at 20:11 UTC
Would this be possible to be stored in reference? Getting confused with the data type. `my %seen1; my $out1 = grep { ! $seen1{ $_->{ID} }++ } @in; pp @{ $out1 };` [download]	[reply] [d/l]
Re^3: Duplicated data in array. (updated) by AnomalousMonk (Archbishop) on Nov 02, 2021 at 20:27 UTC
Untested: `my %seen1; my @out1 = grep { ! $seen1{ $_->{ID} }++ } @in; my $arrayref = \@out1; pp $arrayref;` [download] Update: Perhaps a bit late for this afterthought, but the general form of this question is "How do I create a reference to X?" Please see perlref and perlreftut. See also Perl Data Structures Cookbook (perldsc) for dealing with complicated referential structures. Give a man a fish: `<%-{-{-{-<`	[reply] [d/l] [select]
Re^3: Duplicated data in array. by LanX (Saint) on Nov 02, 2021 at 20:35 UTC
`my $out1 = [ grep { ! $seen1{ $_->{ID} }++ } @in ];` [download] Cheers Rolf _{(addicted to the Perl Programming Language :) Wikisyntax for the Monastery}	[reply] [d/l]
Re: Duplicated data in array. by hippo (Bishop) on Nov 02, 2021 at 22:12 UTC
It's an FAQ! 🦛	[reply]
Re: Duplicated data in array. by Anonymous Monk on Nov 02, 2021 at 19:07 UTC
As usual you are showing nonsense code to pretend you made any effort.	[reply]


Problems? Is your data what you think it is?
	PerlMonks