Ah, now I understand! A small change in the flatten subroutine should fix that.

sub flatten {
    my ($struct) = @_;
    if (ref [] eq ref $struct) {
        return map flatten($_), @$struct
    } else {
        return \$_[0]  # <- We need to use the alias, not a copy.
    }
}
[download]