I can't resist offering a shorter Perl 6-solution:

my %out = map {$^k => [$^v, $^w]}, @ref;

The ^ secondary sigil ("twigil") is a self declaring formal paramter, all of the variables starting with $^ will be filled in the block in lexicographic order.