You've got a serious design problem is config loading speed is an issue.

And the format shouldn't matter one bit. Perl is a much more complicated language than XML, YAML, JSON, INI, etc and it only took 14ms to parse 10,000 configuration items on my aging machine. It's the implementation that's going to matter.