As another data point, Perl 5.005_03 crashes on this, and 5.7 (as of a few months ago) does what 5.6 does.

I would report this as a bug to p5p, and also make sure to actually initialize all rows in the array of arrays before proceeding to use it as such.