unicode in perl

paramjit has asked for the wisdom of the Perl Monks concerning the following question:

I am trying to write a string to a unicode file but not all the characters are written to the file my code is

$file="Test1.enc"; 
open my $FH, ">:raw:encoding(UTF16-LE):crlf:utf8", "$file"; 
print $FH "\x{FEFF}"; 
print $FH "„qy„{z„·{„Źy„Ł„Ź~"; 
print $FH "$enc1"; 
close $FH;
[download]

can anyone please tell me what am i doing wrong when i open the Test1.enc i get qy{z.{yŁ„Ź~ Thanks

Comment on unicode in perl Download Code

Replies are listed 'Best First'.
Re: unicode in perl by ikegami (Patriarch) on Jun 27, 2011 at 07:08 UTC
You're viewing your source as cp1252, but the encoder expects Unicode code points. Your string is really: `0084 <-- A nameless, graphless control char 0071 LATIN SMALL LETTER Q 0079 LATIN SMALL LETTER Y 0084 007B LEFT CURLY BRACKET 007A LATIN SMALL LETTER Z 0084 00B7 MIDDLE DOT 007B LEFT CURLY BRACKET 0084 008F SINGLE SHIFT THREE 0079 LATIN SMALL LETTER Y 0084 00A3 POUND SIGN 007F DELETE 0084 008F SINGLE SHIFT THREE 007E TILDE` [download] You could do `use Encode qw( decode ); print $FH decode('cp1252', "... the string ...");` [download] If you do, Perl will see the string the same way you are viewing it. However, you should save your source as US-ASCII or UTF-8. Use `use utf8;` if you do the latter.	[reply] [d/l] [select]
Re^2: unicode in perl by paramjit (Novice) on Jun 27, 2011 at 07:43 UTC
ok here is my problem what i need to do is write the sequence generated from a function to a file which is has encoding as unicode qy{z{y~ is what i get in the file why are the ,, characters missing	[reply]
Re^3: unicode in perl by ikegami (Patriarch) on Jun 27, 2011 at 07:50 UTC
This post doesn't add anything new. You have text encoded using cp1252 and you are pretending it's not encoded. Decoding it will do the trick.	[reply]
Re^4: unicode in perl by paramjit (Novice) on Jun 27, 2011 at 07:58 UTC
Re^5: unicode in perl by ikegami (Patriarch) on Jun 27, 2011 at 08:22 UTC
Some notes below your chosen depth have not been shown here
Re: unicode in perl by ikegami (Patriarch) on Jun 27, 2011 at 06:45 UTC
I don't see the difference between the two strings	[reply]
Re: unicode in perl by paramjit (Novice) on Jun 27, 2011 at 06:53 UTC
i have updated the output	[reply]