Re^3: What's the best way to detect character encodings, Windows-1252 v. UTF-8?

open(my $fh, '<:raw:perlio', $qfn)
[download]

and

open(my $fh, '<', $qfn)
binmode($fh);
[download]

would do, but then you'd have to do CRLF translation.

open(my $fh, '<', $qfn)
[download]

will actually work and properly do the CRLF translation (unless you set some default layers somewhere) despite decoding and CRLF translation being done in the wrong order. Note that

open(my $fh, '<:encoding(UTF-8)', $qfn)
[download]

also decodes and does CRLF translation in the wrong order. That's why

open(my $fh, '<:encoding(UTF-16le)', $qfn)
[download]

doesn't work on Windows (of all places!).

Comment on Re^3: What's the best way to detect character encodings, Windows-1252 v. UTF-8? Select or Download Code

Replies are listed 'Best First'.
Re^4: What's the best way to detect character encodings, Windows-1252 v. UTF-8? by Jim (Curate) on Jun 17, 2011 at 16:38 UTC
So I think you're saying I should do the simplest thing and just open the files without specifying any I/O layer. In this case, Perl will do what I want. It will slurp the bytes of the file into a variable that it understands contains bytes, not characters, and it will also do what I want it to do with newlines, which is effectively to pass them through unmolested. What does `'<:raw:perlio'` do, exactly? Jim	[reply] [d/l]
Re^5: What's the best way to detect character encodings, Windows-1252 v. UTF-8? by ikegami (Patriarch) on Jun 17, 2011 at 18:55 UTC
That would the simplest. :raw removes all layers, not just :crlf. :perlio is a buffering layer.	[reply]