my %seen;
for (...) {
   next if $seen{$numOne}++;   <-- Add this to your display loop.
   ...
}
[download]

If you really did want to remove them

my %seen;
for my $set (
   \%numOneHash,
   \%numTwoHash,
   \%numThreeHash,
   \%numFourHash
) {
   delete @$set{ grep $seen{ $set->{$_}[3] }++, keys %$set };
}
[download]

Update: Added second half.