"But Perl doesn't seem to like this at all" and "I also can't get the program to run." are very poor descriptions. In the future, give error messages, etc

You want the hash referenced by $people{$key}.
Two steps.
1. Start with the reference: $people{$key}.
2. Then dereference it: %{ $people{$key} }.