Isn't this just a case of the wrong data structure? As shown it is a hash of arrays. If it were a Hash of Hashes the problem goes away.

A better question might be, why a HoH or HoA at all. Shouldn't data like this be in a database?