I can't comment on the bug itself but why don't you use the exists() function on your hash key prior to your logic?

Something like (untested):

 unless(exists $hash{$key})
 {
   # Do stuff

   return;
 }
 if($hash{$key} > 3)
 {
   # Other stuff
 }
[download]