The best thing i could come up with was something that identified which keys have duplicate values but i don't know how to delete all but 1.

Can you share your code?

Edit - Here's one option:

use strict;
use warnings;
use Array::Compare;
use Data::Dumper;

my %hash = (
    'a' => [ '1', '2' ],
    'b' => [ '2', '3' ],
    'c' => [ '1', '2' ]
);

my $comp = Array::Compare->new;

for my $key1 ( keys %hash ) {
    for my $key2 ( keys %hash ) {
        next if $key1 eq $key2 or !$hash{$key1};
        delete $hash{$key2}
          if $comp->compare( \@{ $hash{$key1} }, \@{ $hash{$key2} } );
    }
}

print Dumper \%hash;

[download]

Output:

$VAR1 = {
          'c' => [
                   '1',
                   '2'
                 ],
          'b' => [
                   '2',
                   '3'
                 ]
        };

[download]

The or !$hash{$key1} notation avoids autovivification in cases where the key no longer exists.

In reply to Re: Removing duplicate values for a hash of arrays by Kenosis
in thread Removing duplicate values for a hash of arrays by perlvroom

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.