Think of the reference like the address of a room.

You are changing the inhabitants of always the same (hotel) room and every time storing the address to this one room.

Your dumps inside the loop only show the temporary inhabitants, but your last dump will only show the last inhabitants for always the same address.

Using my will tell Perl to always create a new proper room with a unique address.

Clearer?