Swapping back and forth (and back and forth again) between the hash and a list is still inefficient.

Use a hash reference instead, so it won't have to make multiple copies of your hash contents.