Yes, but your hash assignment and scalar constant are wrong.

use strict; use warnings; 
use Data::Dumper; 
my $hash = {"\"" => 1,':'=>2}; 
print Dumper($hash);
[download]

Any characters can be used in keys, but the scalar constants must be quoted/escaped properly when using one to assign the key.