There are several Perl modules on CPAN for parsing XML, all with different properties. The Perl-XML Frequently Asked Questions has a section called How to choose a parser module which assesses speed:

If speed is critical, you'll find that XML::LibXML is much faster but a bit more 'bleeding edge'.

Disclaimer: I have not used any XML module for speed critical applications.