Yes, you can use umlauts in your xml, and XML::Parser is okay with them. Just do two things:
When you new your XML::Parser, specify
ProtocolEncoding => "Latin-1"
If you don't have a file called Latin-1.enc under your XML/Parser/Encodings directory, get it from somewhere or make one for yourself. If you already have it, you are ready to go now.