in reply to Re^4: Character encoding in console in Windows
in thread Character encoding in console in Windows

From my brief research ( microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/chcp.mspx?mfr=true ), it looks like trying to set the console encoding with system (chcp XXX) seems like a bad idea. It doesn't even seem possible to set it to UTF-8, and setting it to anything else will probably make it impossible to use the very characters that are causing the problems in the first place, because there is no single OEM codepage that covers all the characters people may use... and I'd be reluctant to mess with the settings of other people's computers anyway (does this setting only affect the current session or is it permanent?)

So reading the console's encoding (which depends on OS localization) and then converting the incoming text in Perl accordingly sounds better to me... but I'm just taking stabs in the dark. I can't follow half of the posts here, but I can't see working code in any of them so far.

BTW as I said before, this is just one half of the issue.
Even if I were to go
#!/usr/bin/perl use strict; use warnings; use utf8; open(FILE, "<:encoding(UTF-8)", "c:\\folder\\í.txt") or print "Oops, c +an't open file: $!"; <STDIN>;
..and save this in UTF-8, it would still fail to open the file. It seems pretty clear that I'd need to use one of the modules to ever be able to open a file with a non-ASCII name, and I can't really make sense of the documentation of the modules.

So the step-by-step seems to be:
1) read what the console's OEM encoding is
2) convert filepath received via STDIN from OEM to UTF-8
3) open the file using one of the Unicode modules

...or maybe I'm completely wrong.

Replies are listed 'Best First'.
Re^6: Character encoding in console in Windows
by ikegami (Patriarch) on Sep 18, 2010 at 01:49 UTC

    it would still fail to open the file.

    Correct. You'd need to encode using the current ANSI code page (Windows) or current locale encoding (unix).

    In Windows, you could also use the system's wide character interface (CreateFileW) via some means other than open. Win32API::File's CreateFileW function would be one such mean.

      Indeed you are right, I just tested it. If I encode the script in ANSI (which on my computer means Latin-2) - and remove the use UTF-8 line, of course - then it works. Not much of a general solution as other people will have different encodings on their Windows machines, but it's at least some limited functionality for some situations.