printf (a personal preference to debug statement like this) and different quoting might have avoided confusion in this case:
# print "\$key is |$key| and \$value is |$value| or |$conf{'$key'}|.\n
+";
printf '$key is |%s| and $value is |%s| or |%s|'."\n", $key, $value,
+$conf{$key};