See perldata, first paragraph:

Hashes are unordered collections of scalar values indexed by their associated string key.

So, you can't use any scalar as a hash key, just a string.

There is the module Tie::RefHash though, which allows you to use references as hash keys, which seems to be what you're trying to do.