string conversion problem

stormbow has asked for the wisdom of the Perl Monks concerning the following question:

Replies are listed 'Best First'.
Re: string conversion problem by Your Mother (Archbishop) on Mar 07, 2013 at 06:07 UTC
You tried what now? :P `perl -MURI::Escape -le 'print uri_unescape("%E4%BA%8E%E6%96%AF%E5%B1%88%E8%BE%BE%E5%B0%94")'` 于斯屈达尔	[reply] [d/l]
Re^2: string conversion problem by Anonymous Monk on Mar 07, 2013 at 07:27 UTC
What the..... That piece of Chinese charater string you get is absolutely right. But I simply CANNOT get the same result. The exact same code produces "浜庢柉灞堣揪灏" on my computer. Is there some configuration stuff that I'm missing? BTW I'm coding on a winxp machine with activePerl. Also, the solution that Khen1950fx presents probably should produce the correct result but it just does not work for me either.	[reply]
Re^3: string conversion problem by Your Mother (Archbishop) on Mar 07, 2013 at 17:05 UTC
Try this...? This is along the lines aitap wrote about. `perl -CSD -MEncode -MURI::Escape -le 'print decode "UTF-8", uri_unescape("%E4%BA%8E%E6%96%AF%E5%B1%88%E8%BE%BE%E5%B0%94")'` You might need to reverse the quotes for your box.	[reply] [d/l]
Re: string conversion problem by aitap (Curate) on Mar 07, 2013 at 07:36 UTC
The result of `uri_unescape` contains bytes, not characters: `$ perl -Mutf8 -MURI::Escape -E'say utf8::is_utf8(uri_unescape shift) ? + "characters" : "bytes"' %E4%BA%8E%E6%96%AF%E5%B1%88%E8%BE%BE%E5%B0%9 +4 bytes` [download] Perhaps you need to decode these bytes to the internal character representation and then encode them on output as you need: `$ perl -MEncode=decode -MData::Dumper -MURI::Escape -e 'print Dumper d +ecode utf8 => uri_unescape shift' %E4%BA%8E%E6%96%AF%E5%B1%88%E8%BE%B +E%E5%B0%94 $VAR1 = "\x{4e8e}\x{65af}\x{5c48}\x{8fbe}\x{5c14}";` [download] Once you have characters instead of bytes you can encode them as you want using `:encoding` IOLayer or `encode` function from Encode module. Sorry if my advice was wrong.	[reply] [d/l] [select]
Re: string conversion problem by Khen1950fx (Canon) on Mar 07, 2013 at 06:06 UTC
How about this? Is that the correct string? `#!usr/bin/perl -l use strict; use warnings; use URI::Encode qw(uri_decode); my $encoded = "%E4%BA%8E%E6%96%AF%E5%B1%88%E8%BE%BE%E5%B0%94"; print uri_decode($encoded);` [download]	[reply] [d/l]
Re: string conversion problem by stormbow (Initiate) on Mar 08, 2013 at 02:43 UTC
YourMother and aitap. The exact code snippets you guys gave do not produce the correct string on my machine. But with your helpful discussion, I finally figured out what worked for me: `perl -MEncode -MURI::Escape -le "print encode('gbk',decode('utf8',URI::Escape::uri_unescape shift))" %E4%BA%8E%E6%96%AF%E5%B1%88%E8%BE%BE%E5%B0%94` Thank you very very much for the help. Also, it would be great if any of you can explain to me why I need the above code on my computer while a simple uri_unescape works for YM.	[reply] [d/l]