He Googles for help

utf16le site:perlmonks.org
UTF-16 on WinXP written by Perl shows whitespaces.
crlf mess in unicode utf-16le

Can someone explain how this sequence of PerlIO layers works?

See PerlIO

Why must so many layers be used?

Because of the defaults, see PerlIO

Can these layers be specified using the open pragma? If so, how? If not, why not?

This should work 

use open qw' IO :raw:perlio:encoding(UTF-16LE):crlf ';

[download]
but apparently open pragma is broken and doesn't accept the same things as binmode/open

And why has this ancient Perl bug still not been fixed in 5.12.2?

I'm not a perl5-porter so I'm not sure, but it doesn't look like a bug exactly, and nobodys come up with a better way, or reported a bug (that I could find).

It seems there's no way to generate a UTF-16 file in little-endian byte order directly. To generate such a file, you have to specify the UTF-16LE CES (which is wrong) and add the byte order mark explictly to make it UTF-16 instead of UTF-16LE.

maybe :encoding(UTF-16LE):via(File::BOM)

In reply to Re: Chicanery Needed to Handle Unicode Text on Microsoft Windows by Anonymous Monk
in thread Chicanery Needed to Handle Unicode Text on Microsoft Windows by Jim

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.