Does that mean I would need to change the whole code?

Yes.  It wouldn't make much sense having an XML::Simple, if its disadvantages (in some contexts) wouldn't be outweighed by its somewhat simpler usage.