Re^2: Unicode strangeness

Tested on Windows XP. Neither worked. However the thought is definitely very decent. I probably know where your thought came from: in the old days, :raw reverses :crlf, but it no longer does.

use strict;
use warnings;

use charnames ':full';


open( my $fh, ">:raw:encoding(ucs2le):crlf", "test.plp" );
print $fh "\N{CARRIAGE RETURN}\N{LINE FEED}";
close $fh;

#test
open(PLP,"<","test.plp");
my $string;
sysread(PLP, $string, 100);
printf("0x%02x ", ord($_)) for (split //, $string);
[download]

This prints:

0x0d 0x00 0x0d 0x00 0x0a 0x00
[download]

use strict;
use warnings;

use charnames ':full';


open( my $fh, ">:encoding(ucs2le):crlf", "test.plp" );
print $fh "\N{CARRIAGE RETURN}\N{LINE FEED}";
close $fh;

#test
open(PLP,"<","test.plp");
my $string;
sysread(PLP, $string, 100);
printf("0x%02x ", ord($_)) for (split //, $string);
[download]

This prints:

0x0d 0x00 0x0d 0x0a 0x00
[download]

Comment on Re^2: Unicode strangeness Select or Download Code

Replies are listed 'Best First'.
Re^3: Unicode strangeness by graff (Chancellor) on Oct 16, 2005 at 02:55 UTC
The whole point of ":crlf" mode is that, when you say "\n" (LINE_FEED) in your code, perl interprets that to mean "newline event", which by definition comes out as "CARRIAGE_RETURN LINE_FEED" (hence the name ":crlf" mode); when you use this mode, you would never explicitly print a "\r" (carriage return) to such a file handle, unless you really want an "extra" carriage return in the output. OTOH, you can leave off ":crlf", explicitly print "\r" wherever/whenever you want, and not get them added automatically when you print "\n". Since you seem fixated on explicitly printing the carriage returns yourself, and not having them added automatically to every line feed that you print, just leave out ":crlf". Based on the tests you've shown, it is essential in any case to make sure the mode begins with ":raw". Without this, the default (actually implicit) ":crlf" mode will somehow be treated in the wrong sequence relative to the ucs2le mode, and the "crlf" sequence does not get converted to a valid sequence of two 16-bit unicode characters. In terms of the code you're showing: `## instead of this: open( my $fh, ">:raw:encoding(ucs2le):crlf", "testa.plp" ); print $fh "\N{CARRIAGE RETURN}\N{LINE FEED}"; close $fh; ## you want either this: open( my $fh, ">:raw:encoding(ucs2le)", "testb.plp" ); print $fh "\N{CARRIAGE RETURN}\N{LINE FEED}"; close $fh; ## or this: open( my $fh, ">:raw:encoding(ucs2le):crlf", "testc.plp" ); print $fh "\N{LINE FEED}"; # :crlf adds CARRIAGE RETURN for you close $fh;` [download] Just for the sake of parsimony and lower probability of screwing things up, I'd prefer the last approach, personally.	[reply] [d/l]

Replies are listed 'Best First'.

Re^3: Unicode strangeness
by graff (Chancellor) on Oct 16, 2005 at 02:55 UTC

never

OTOH, you can leave off ":crlf", explicitly print "\r" wherever/whenever you want, and not get them added automatically when you print "\n".

Since you seem fixated on explicitly printing the carriage returns yourself, and not having them added automatically to every line feed that you print, just leave out ":crlf".

Based on the tests you've shown, it is essential in any case to make sure the mode begins with ":raw". Without this, the default (actually implicit) ":crlf" mode will somehow be treated in the wrong sequence relative to the ucs2le mode, and the "crlf" sequence does not get converted to a valid sequence of two 16-bit unicode characters. In terms of the code you're showing:

## instead of this:

open( my $fh, ">:raw:encoding(ucs2le):crlf", "testa.plp" );
print $fh "\N{CARRIAGE RETURN}\N{LINE FEED}";
close $fh;

## you want either this:

open( my $fh, ">:raw:encoding(ucs2le)", "testb.plp" );
print $fh "\N{CARRIAGE RETURN}\N{LINE FEED}";
close $fh;

## or this:

open( my $fh, ">:raw:encoding(ucs2le):crlf", "testc.plp" );
print $fh "\N{LINE FEED}";  # :crlf adds CARRIAGE RETURN for you
close $fh;
[download]

[reply]
[d/l]