Go re-read the answers you got to Need some help building a data structure.. You haven't told us enough about the problem you are trying to solve.

Based on the information you've given so far, there is no easy way to build what you seem to be asking for because, for example, ...{key4} can't hold both a hash reference and an array reference. How do you want to handle that?

But really, tell us what the bigger problem is you are trying to solve. I suspect you've latched on to trying to solving an implementation detail where you should be revising an issue with the larger problem.