I'm not sure of a better data structure, but there is a better way to build that second hash:

my %note_at = reverse %position_of;
[download]