I would write:

@flat = grep {defined} map {@$_} grep {$_} @AoA;
[download]

This assumes each element of @AoA is either an arrayref, or an undefined value.

I'm not the biggest fan of using EXPR ? LIST : () inside a map just to avoid writing grep.