Just only my opinion:
1/ Parse xml files at server startup (for instance, using XML::Simple) and store it in global variable
2/ It is chance to avoid the memory consumption if you will not change this global variable in child processes - hopefully it will stay in memory page shared across httpd's.
3/ If you really need to store and load this confs quickly, use Data::Dumper as Zaxo recommends...