XML Encoding Problem

merrymonk has asked for the wisdom of the Perl Monks concerning the following question:

I have a Perl function that lets me alter the xml file that is created by another application.
Everything was OK but recently the first line of the xml file was changed to

<?xml version="1.0" encoding="UTF-8"?>

Now character Ā (A with a caret above it) - is no longer in front of the
degree sign after I have made modifications and the xml file can no longer be read with
Windows Explorer.

I start ‘reading’ the XML file with

    $parser_res = 1;
    $parser = XML::DOM::Parser->new(KeepCDATA => 1);
[download]

Does any wiser Monk than I know how to cure this?
For example, is an additional argument required in the Parser statement.
The problem can be solved by opening and closing the file by the main application
but that is something I do not want to do.

Comment on XML Encoding Problem Download Code

Replies are listed 'Best First'.
Re: XML Encoding Problem by idsfa (Vicar) on Nov 10, 2005 at 15:53 UTC
You have not given us the information we need to help you. Where were/are the Ā and the ° you mention? How are you writing the file back out in perl? That said, is this your problem? The intelligent reader will judge for himself. Without examining the facts fully and fairly, there is no way of knowing whether vox populi is really vox dei, or merely vox asinorum. — Cyrus H. Gordon	[reply]
Re^2: XML Encoding Problem by merrymonk (Hermit) on Nov 10, 2005 at 17:18 UTC
The Ā is just before the degree sign. I am writng the xml file with `$xml_doc->printToFile($xml_file);` [download] . I will look at the reference you have given it may have the answer.	[reply] [d/l]
Re: XML Encoding Problem by Aristotle (Chancellor) on Nov 10, 2005 at 20:14 UTC
Sounds to me like your encoding handling was broken before (what you describe seems like UTF-8 that was interpreted as ISO-8859-1), and might be correct or possibly broken (but in another way) now. Without samples of your inputs and outputs it’ll probably be impossible to guess what’s up. In the meantime, you should read The Absolute Minimum Every Software Developer Absolutely, Positively Must Know About Unicode and Character Sets (No Excuses!). Makeshifts last the longest.	[reply]
Re: XML Encoding Problem by grantm (Parson) on Nov 10, 2005 at 23:34 UTC
The Perl XML FAQ has plenty to say about encodings.	[reply]